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Series Editors’ Foreword 



The topics of control engineering and signal processing continue to flourish and 
develop. In common with general scientific investigation, new ideas, concepts and 
interpretations emerge quite spontaneously and these are then discussed, used, 
discarded or subsumed into the prevailing subject paradigm. Sometimes these 
innovative concepts coalesce into a new sub-discipline within the broad subject 
tapestry of control and signal processing. This preliminary battle between old and 
new usually takes place at conferences, through the Internet and in the journals of 
the discipline. After a little more maturity has been acquired by the new concepts 
then archival publication as a scientific or engineering monograph may occur. 

A new concept in control and signal processing is known to have arrived when 
sufficient material has evolved for the topic to be taught as a specialised tutorial 
workshop or as a course to undergraduate, graduate or industrial engineers. 
Advanced Textbooks in Control and Signal Processing are designed as a vehicle 
for the systematic presentation of course material for both popular and innovative 
topics in the discipline. It is hoped that prospective authors will welcome the 
opportunity to publish a structured and systematic presentation of some of the 
newer emerging control and signal processing technologies in the textbook series. 

There are a considerable number of multivariable industrial processes which 
are controlled by systems designed using single-input, single-output control design 
methodologies. One reason for this is that multivariable systems textbooks often 
incorporate a significant amount of mathematics which tends to obscure the 
potential benefits that can be obtained from exploiting the multivariable structure 
and properties of multi-input, multi-output systems. In this new textbook, Pedro 
Albertos and Antonio Sala have made considerable efforts to discuss and illustrate 
the inherent meaning and interpretation of the principles within multivariable 
control system design. This is reflected in a book structure where after several 
chapters on models and linear system analysis Chapter 4 pauses to review the 
control roadmap ahead in the second part of the book. This roadmap has chapters 
devoted to centralised multivariable control methods, optimisation-based methods, 
robustness and implementation issues. In the presentation there is a clear indication 
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that the authors are very aware of current industrial control system design practice. 
This is seen through the choice of industrial and practical examples chosen to 
illustrate the control system principles presented. These include a paper machine 
head box control system, a (3x3) distillation column problem, a steam-boiler 
system and a really interesting ceramic kiln control system problem. The kiln 
problem is used to show that the industrial multivariable control system design 
problem has a wealth of associated problems which also have to be considered and 
solved. Indeed the ceramic kiln problem is similar to other processes like that of 
plate-glass manufacture, and the reheating of steel slabs in a walking beam furnace 
in the steel industry. 

The discussion of the various issues in multivariable control system design is a 
particularly attractive feature of the book since this helps to put into context and 
perspective some difficult theoretical issues. The chapter on robustness (Chapter 8) 
is a good example of a discussion chapter from which the reader can decide 
whether to delve further into the supporting technical appendix and references. 
The book is suitable for final-year undergraduates, and graduate students who will 
find the valuable insights, and illustrative examples particularly useful to their 
studies of multivariable control system design and implementation. Lecturers and 
professionals in the control field will find the industrial context of the examples 
and discussions a refreshing change from the usual more straightforward academic 
multivariable systems control textbooks. 



M.J. Grimble and M.A. Johnson 
Industrial Control Centre 
Glasgow, Scotland, U.K. 

Summer 2003 




Preface 



‘“Engineering approach’ implies lots of shortcuts and simplifications. Simpli- 
fication often means telling the truth but not the whole truth. If it were the 
whole truth, it would not be simple!” (Bob Atkins). 



Control engineering is a multidisciplinary subject, useful in a variety of 
fields. Process control, servosystems, telecommunications, robotics, or social 
system dynamics, among others, require the concourse of automatic control 
concepts to better understand the behaviour of the respective processes and 
to be able to introduce changes in their dynamics or counteract the effect of 
disturbances. 

Recent industrial trends in the implementation of control systems claim a 
wider perspective in the design, not just a collection of single-loop controllers, 
coping with a complex system with multiple interrelated variables to be con- 
trolled and having the option to manipulate multiple variables. The first step 
in this direction is to consider the control of multivariable systems. 

The aim 

Talking about control problems and moving to wonderful mathematical ab- 
stractions is very tempting. The complexity and elegance of many control 
problems have attracted the interest of theorists and mathematicians, devel- 
oping more or less complex control theories that are not always well connected 
to the practical problems. However, in this book, the theory is used as a sup- 
port to better understand the reasons and options of some control design 
techniques rather than to enter into the details of a given issue, even if this 
issue can be the matter of dozens of research papers. 

The book presents the fundamental principles and challenges encountered 
in the control of multivariable systems, providing practical solutions but keep- 
ing an eye on the complexity of the problem to decide on the validity of the 
results. We are not interested in control design recipes, although guidelines 
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are welcome, and always try to analyse the proposed solution and suggest al- 
ternatives. The study of some of the control options for multivariable systems, 
their physical understanding and reasoning, and their tuning in real applica- 
tions is the main aim of the book, devoting also some effort to the available 
tools used in their computer-aided design. 

The content 

The book is structured to cover the main steps in the design of multivariable 
control systems, providing a complete view of the multivariable control design 
methodology, with case studies, without detailing all aspects of the theory. An 
introductory chapter presents in some extent the general issues in designing 
control systems, guiding the reader through the subjects to be treated later 
on. As most control systems are conceived to be digitally implemented in 
a computer-based system, the use of process models is generalised and the 
control design approach is based on a model of the process. This is the subject 
of Chapter 2, where the representation of linear systems, in continuous and 
discrete time, is dealt with in some detail. Although there is an introduction 
to the modelling of non-linear processes, approximation techniques move the 
problem to the linear “arena”, where the theory is simpler and well known 
and the concepts can be acquired more easily. 

Chapter 3 deals with the tools for extracting properties from the models, 
including models of the process, the controller and the whole controlled sys- 
tem. This is a key chapter that provides the basis of analysing the behaviour 
of a system and its possibilities of being controlled. Emphasis is placed on the 
structural properties of multivariable systems and issues such as directional- 
ity and interaction, not relevant in single-input-single-output (SISO) systems, 
are discussed. Using the analysis results, model reduction techniques are in- 
troduced. 

The general options in designing a control system are the subject of Chap- 
ter 4, where an analysis of the advantages and drawbacks of different control 
structures is presented. This is an introduction to the rest of chapters, where 
different design and implementation control techniques are developed. Decen- 
tralised and decoupled control is the subject of Chapter 5. Here, most of the 
ideas of SISO control system design are useful, being complemented with the 
analysis of the loops’ interaction and the crucial issue of variables selection 
and pairing. Some guidelines for the setting of a multi-loop control system are 
discussed. 

Full advantage of the internal representation is taken in Chapter 6 to intro- 
duce the centralised control structure. All the ideas presented in the previous 
chapters are used here to present a methodology for the integrated design of a 
control system with multiple controlled variables. The classical state feedback 
strategy, complemented with the use of state observers, provides a solution 
that is easily implemented in a digital computer and reduces the cost of instru- 
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mentation. Virtual sensors are a step further in the construction of observers 
and present an attractive solution from an engineering viewpoint. 

One of the characteristics a control user demands is the interpretability of 
the tuning parameters of a control system. Cost or performance indices are a 
suitable way of expressing some requirements, even using limited options such 
as norms of variables, and optimal control provides an effective approach to 
controller design. In Chapter 7, the assumption of linear models simplifies the 
treatment and allows us to find a closed solution that can be implemented as 
a linear controller. 

The treatment of uncertainty in the models (and even in the requirements) 
is fundamental from an engineering viewpoint, as the models are always partial 
representations of the process behaviour. An introduction to robust control 
design techniques, as a variation of optimal control, is presented in Chap- 
ter 8, complemented with additional readings and material presented in an 
appendix. 

Implementation of the designed control is a key factor in the success 
of a control system. Many issues are application-dependent, but a number 
of general guidelines and warnings are the subject of Chapter 9. The inte- 
grated treatment of the control design and its implementation, in resource- 
constrained environments, is a matter of research interest and should be al- 
ways kept in mind by a control design engineer. 

The use of the internal representation provides a good framework for re- 
viewing the control concepts in a general way, with validity not only for mul- 
tivariable systems but also for SISO. The introduction of tools for analysing 
and designing robust control systems is also an added value of the book and 
a motivation to enter into this control design methodology. 

As previously mentioned, all the relevant concepts are illustrated with 
examples, and programming code and simulation diagrams are provided to 
make the validation of the results easy as well as the grasping of the concepts. 
A number of case studies present a joint treatment of a number of issues. 
Unfortunately, there is no room to describe in full detail the practical design 
and implementation of a complete application. This is something that the 
reader could try to carry on in his/her own control problem. 

A number of appendices include some reminders and new ideas to help 
in the reading of the main body of the book, giving a self-contained feature, 
always desirable in a book with a large audience. Of course, the analysis and 
representation tools are also developed, but they are always considered as 
a way of achieving the final control system design and evaluation. Examples 
with high-level simulation packages, mainly Matlab® , are provided. The case 
studies and the chapter examples lead the reader into a practical perspective 
of the control solution. Usually, a full design completing additional issues of 
the case studies could be attempted as an exercise. Additionally, a large list of 
references will provide alternative reading to those interested in more rigorous 
treatment of the topic or more detailed specific applications. 
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The audience 

This is not an ambitious book either from the theoretical perspective or from 
the end-user viewpoint, but it is trying to bridge the gap between these two 
extremes. The main goal is to present in an easy-to-read way the challeng- 
ing control problems involving subsystems, interactions and multiple control 
objectives, introducing some tools for designing advanced control systems. 

There is a wide audience of engineers and engineering students with a 
background of basic control ideas grasped in their previous studies or in their 
practical experience in designing systems. This is a heterogeneous audience 
coming from different fields, such as instrumentation in the process indus- 
try, the design of electronic devices, the study of vibrations and dynamics in 
mechanical systems or the monitoring of process units. 

The book can be helpful in introducing the basic concepts in multivariable 
linear control systems to practical engineers. The control problems may be 
familiar to them and the presented tools will open their mind to find appro- 
priated solutions. 

For senior undergraduate students that previously had grounding in SISO 
control (PID, root locus, discretisation of regulators), the challenge is to 
convey the basic heuristic ideas regarding multivariable control design in a 
one-semester course, presenting the necessary mathematical tools as they are 
needed and putting emphasis on their use and intuition, leaving the details of 
the theory for more advanced texts. 
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Introduction to Multivariable Control 



This introductory chapter is devoted to reviewing the fundamental ideas of 
control from a multivariable point of view. In some cases, the mathematics 
and operations on systems (modelling, pole placement, etc.), as previously 
treated in introductory courses and textbooks, convey to the readers an un- 
realistic image of systems engineering. The simplifying assumptions, simple 
examples and “perfect” model set-up usually used in these scenarios present 
the control problem as a pure mathematical problem, sometimes losing the 
physical meaning of the involved concepts and operations. We try to empha- 
sise the engineering implication of some of these concepts and, before entering 
into a detailed treatment of the different topics, a general qualitative overview 
is provided in this chapter. 



1.1 Introduction 

The aim of a control system is to force a given set of process variables to behave 
in some desired and prescribed way by either fulfilling some requirements of 
the time or frequency domain or achieving the best performances as expressed 
by an optimisation index. 

The process engineers design the process according to the best of their 
knowledge in the field and by assuming some operating conditions. Later 
on, the process will run under some other conditions that support external 
disturbances usually not well known or determined. Also, the characteristics of 
the process will change with time and/or the load. It is the role of the control 
system to cope with these changes, also providing a suitable behaviour. 

The scope of the control tasks varies widely. The main goal may be to keep 
the process running around the nominal conditions. In other cases, the control 
purpose will be to transfer the plant from one operating point to another or 
to track a given reference signal. In some other cases, the interest lies in 
obtaining the best features of the plant achieving, for instance, the maximum 
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production, minimum energy consumption or pollution, or minimum time in 
performing a given task. 

In a general way, the following control goals can be targeted [17]: 

• regulation (disturbance rejection), 

• reference tracking, 

• generation of sequential procedures (for start-up or shut-down), 

• adaptation (changing some tunable parameters), 

• fault detection (to avoid process damage or provide reconfiguration), 

• supervision (changing the operating conditions, structure or components), 

• coordination (providing the set-points), 

• learning (extracting some knowledge from the experience). 

All these different activities result in very distinct control approaches and 
techniques. From logical and discrete-time controllers to sophisticated intel- 
ligent control systems where the artificial intelligence techniques provide the 
framework for emulating human behaviour, the multiple available tools for 
control systems design are complementary and, in the integral control of a 
plant, some of them are used in a cooperative way. 

Our interest in this book will be mainly focused on the regulation and 
set-point tracking of a plant where a number of manipulated variables allow 
joint control of several process variables. In some sense, the coordination is 
considered, but with the specific viewpoint of joint control of a multivari- 
able system. These problems are basic ones and appear recurrently in some 
others, such as batch processes, sequential control or fault tolerant control. 
But that means that no specific attention will be paid to the starting-up and 
shutting-down phases, although in some cases the tracking concepts could 
be applicable. Neither alarm treatment nor learning and adaptation will be 
considered, although, as previously mentioned, all these activities are usually 
required to automatically run a complex system. 

It is interesting to note, at the very beginning, that the controller could be 
considered as a subsystem feeding the controlled system with the appropriate 
signals to achieve some goals. That is, the controller is selecting, among the 
options in some manipulated variables , the signals which are appropriate. With 
this perspective, the controller is guiding the process in the desired way, but 
the process itself should be capable of performing as required. 

Traditionally, the role of the control system was to cope with the defi- 
ciencies of the controlled process and the undesirable effect of the external 
disturbances. Nowadays, there is a tendency to integrate the design of both 
the process and the controller to get the best performance. This may result 
in a simpler and more performing global system. For instance, taking into 
account the existence of the control system, a reactor or an aircraft can be 
designed in such a way that they are open-loop unstable and cannot run with- 
out control. But, on the other hand, the controlled system could be cheaper, 
faster, more reliable or more productive. 
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In order to illustrate some basic concepts and ideas to better outline the 
purpose of the book, let us introduce a process control example. Afterwards, 
we will outline basic ideas, further developed in the rest of the chapters. 

Example 1.1. Let us consider a typical process unit for refining a chemical product. 
First, there is a mixing of two raw materials (reactives) to feed a distillation column 
where two final products are obtained, the head and bottom components. In order to 
run the unit, we must control the different flows of material, provide adequate tem- 
perature to the inlet flows and keep the desired operating conditions in the column 
by adjusting its temperature, pressure and composition. Some other complementary 
activities are required, such as agitating the content of the mix tank or keeping the 
appropriate levels in all vessels, including those of auxiliary or intermediate buffers. 
A simple layout of the unit is depicted in Figure 1.1. 




Figure 1.1. Distillation unit 



The ultimate control goal is to obtain the best distilled products (maximum pu- 
rity, less variance in concentration, ... ) under the best conditions (maximum yield, 
minimum energy consumption, ... ), also taking into consideration cost and pollu- 
tion constraints. But before we begin to get the products, we must startup all the 
equipment devices, establish a regular flow of reactives, reach the nominal operat- 
ing conditions and then keep the unit stable under production. Also, care should 
be taken about faults in any part of the unit: valves, agitator, existence of raw 
materials, heating systems, etc. 



1.2 Process and Instrumentation 

The process to be controlled is an entity of which the complexity can vary 
from something as simple as a DC motor or a water tank to a very complex 
system such as a mobile platform or an oil refinery. 

Independently of its design, carried out taking into account control re- 
quirements or not, control design assumes that the equipment modules are 
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given and are already interconnected according to the guidelines of the pro- 
cess experts. Sometimes, analysis of expected performance with a particular 
control system may advise changes in the process or instrumentation (sensor 
and actuators); for instance, from the control viewpoint, it could be better 
to feed the mixed material or the reflux of the head product at a different 
column plate, but at this moment it is fixed. 

In order to control the process, some manipulated variables should be 
available, allowing introduction of control actions in the process to force it 
towards evolving in the desired way. In the kind of processes we are going 
to deal with, more than one manipulated variable is always available, provid- 
ing more richness and options in controlling the process. In an automatically 
controlled plant, these manipulated variables will act on the process through 
the corresponding actuators. To get information about the process, some in- 
ternal variables should be measured, being considered as output variables. 
Again, more than one output variable will be considered. The control target 
could be these variables themselves or some other directly related to them: to 
keep them constant in a regulatory system, to track some references in servo 
systems, or to perform in some prescribed way with temporal, harmonic or 
stochastic properties. 

In the distillation unit, Figure 1.1, there are many input variables. We can 
count as many as 14 valves, two pumps and an agitator. All of them can be 
used to drive the unit, being considered as manipulated variables, but most 
of them will be locally controlled or manually fixed and will not intervene 
in the control strategy. Many temperatures, flows, levels or concentrations at 
different points inside the unit can provide information about the behaviour 
of the plant, but not all of them will be measured. Even less will be controlled. 
The set of measurement devices, as well as the instrumentation required to 
condition the measurements, constitute the data acquisition system, which 
itself can be quite complex involving transducers, communication lines and 
converters. These devices will be also fundamental in achieving proper control 

Wi- 
llie input variables or signals acting on the process but not being ma- 
nipulated to achieve the control goals should be considered as disturbances. 
They are usually determined as a result of other processes or, in the simplest 
case, they are assumed to be constant. These disturbances can be predictable 
(deterministic) or not. For instance, in a rolling mill process, the arrival of a 
new block affecting the rolls’ speed is an event that can be predicted but not 
avoided. Also, the disturbances can be measurable or not. Even some charac- 
teristics of the disturbance may be known in advance if it belongs to a class of 
signals. For example, in the distillation column we can get information about 
the raw materials’ concentration, but it is fixed somewhere else and cannot be 
considered as a manipulated variable. Ambient temperature is also a partially 
predictable disturbance. 

It is clear that unpredictable, unknown and unmeasurable disturbances 
are the worst ones to be counteracted by the control actions. 
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Figure 1.2. Process variables 



1.3 Process Variables 

To study the behaviour of a process is to analyse the involved variables and 
their relationship, what is represented by the variable and process models. As 
previously mentioned, with respect to the process shown in Figure 1.2, the 
variables can be: 

• external or inputs, being determined by other processes or the environ- 
ment, acting on the process and considered as: 

manipulated or control variables, u, if they are used to influence the 
dynamics of the process. Actuators will amplify the control commands 
to suitable power levels to modify plant’s behaviour, 
disturbances, d, if they are uncontrollable outputs of other subsys- 
tems, 

• internal, being dependent on the process inputs, system structure and 
parameters. We are interested in evaluating the behaviour of these process 
variables. They can be classified as: 

outputs or measured variables, y , if they are sensed and provide in- 
formation about the process evolution, 

controlled variables, z, if the control goals are based on them. They 
can be outputs or not, depending on the sensors’ availability and place- 
ment, 

state variables, x, as later on properly defined, are a minimum set 
of internal variables allowing the computation of any other internal 
variable if the inputs are known. 

^From an information viewpoint, any process can be considered as an infor- 
mation processor, giving some outputs as a result of the processing of inputs 
and the effect of disturbances 1 . 

1 As usual in control literature, it will be assumed that no significant amount of 
power will be extracted or introduced by the signal processing system (controller) 
into the process, i.e., actuators are considered part of the system and sensors are 
ideal. Otherwise, energy balance equations in the process do change, and the 
model changes accordingly. For details on modelling and system interconnection 
relaxing those assumptions, see [102]. 
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Dynamic physical systems evolve continuously over time. Thus, the in- 
volved variables are functions of time, as are real variables, and are repre- 
sented by continuous-time (CT) signals, (for instance, u(t),u € tgK 

represents a set of m real CT variables) . Nevertheless, for the sake of the anal- 
ysis, only some characteristics of the signals could be of interest. For instance, 
if only the value of these variables at some given time instant is relevant, the 
variables’ model is discrete and they are represented by discrete-time (DT) 
signals, time being an integer variable (t £ Z). In digital control systems, 
signals are quantised (u-i £ Z), due to the finite word-length of the internal 
number representation. Maybe only some levels of the variables are relevant. 
In the simplest case, only two options are considered and the corresponding 
variable is represented by a logical or binary signal (iq £ {0, 1}). 

Most of the distillation unit variables are modelled using CT signals, but, 
for the sake of control, could be treated digitally or logically. For instance, the 
agitator speed could be represented by two options: on and off. Some variables 
could be treated as CT signals if they lie inside a prescribed range of values, 
being considered as saturated or null if they are out of range. That is, the 
same physical variables can be represented by different signals depending on 
the purpose of their treatment. 

As previously mentioned, in some cases, the value taken by a variable as a 
function of time is not relevant and we are interested in some periodic prop- 
erties, such as the frequency components, in magnitude or phase. Harmonic 
analysis (Fourier transform) is thus appropriate. In some other cases, only the 
stochastic properties of the variables are of interest. Consider, for instance, 
the concentration of a distillation product. More than the punctual value of 
the concentration at a time instant, the interest of the user is in the aver- 
age concentration in a reasonable interval, as well as the possible maximum 
deviations. 

In the case of multivariable systems, it is also mandatory to scale the 
variables’ magnitude in order to make them comparable, if different “errors” 
need to be used to compute the control actions. Usually, the significant vari- 
able ranges are normalised so some performance measures can be said to be 
fulfilled if a particular error is lower than 1. This is convenient for quick com- 
parative analysis. 



1.4 The Process Behaviour 

Our main aim is the time response or frequency response of the controlled 
process, when subject to some given reference changes or expected distur- 
bances ( forced response). A related issue is the study of the behaviour of the 
autonomous process when it evolves from some non-equilibrium initial condi- 
tions ( free response). 

Systems could be considered as operators mapping a set of functions of 
time (inputs) onto another (outputs). We are interested in dynamic systems, 
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that is, those whose current internal variables depend on their past value and 
that of the inputs. Dynamic system analysis tools are applied for that purpose. 

To simplify the study, some basic assumptions are made. It is clear that, 
once a time scale is selected, some dynamic subprocesses could be considered 
either infinitely fast (instantaneous or static) or infinitely slow. In this case, 
they are considering as generator of constant signals, without any significant 
evolution. 

Linearity. This is the most important simplification [ 11 ]. A process (as any 
operator) is said to be linear if it accomplish the following linearity principles: 

1 . The response is proportional to the input. That is, if for a given input, 
u(t ), the response is y(t ), for an input au(t) the response is ay(t), atl. 

2 . The effect of various inputs is additive. That is, if for a given input, u±(t), 
the response is y\(t), and for an input, U2(t ), the response is j/2(f), for an 
input u(t) = a\Ui(t) + a.2U2(t) the response is y(t) = a\yi(t) + 02^2 (t). 

Linearity allows us to “split” the study of the dynamic behaviour; the total 
evolution can be computed as the result of external inputs plus the effect of 
some initial conditions. It would also allow the study of the different manip- 
ulated variables, one by one, and the global behaviour would be determined 
by the way the different responses add up altogether. Linear operations with 
sets of variables are dealt with by means of vector and matrix algebra, and 
some results are direction-dependent, as we will see later on. 

Linearisation is an approximation technique allowing the representation 
of the non-linear behaviour of a process by an approximate linear model. 
The linearisation approach is used to consider the relationship between incre- 
mental variables around an equilibrium state, but it requires continuity and 
differentiability in the non-linearities. Although this technique is not always 
applicable (consider, for instance a switching process), in many cases it pro- 
vides good insight into the process behaviour and can be used in the design 
of a suitable controller. 

Approximate linearisation should not be confused with exact linearisation. 
In some processes, with a suitable selection of variables (or a change of vari- 
ables in a given model), or some changes in the system structure (for instance, 
by feed-backing some variables) the resulting model may have the linearity 
properties. Some ideas will be suggested in the final chapter of this book. 

Time invariance. This is another practical assumption, implying that pa- 
rameters and functions appearing in the process model do not change with 
time. 

Usually, the process behaviour changes with time because some parame- 
ters, assumed to be constant, slowly vary with time. Another cause of “ap- 
parent” time-variation is non-linearity: changing the operating point changes 
the approximate linear behaviour. Slow, unmodelled, non-linear dynamics also 
may manifest that way, even without operating point changes. 
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Lumped parameters. In this case, time is assumed to be the unique inde- 
pendent physical variable and the devices’ dynamics are modelled as punctual 
phenomena, without taking into consideration the distributed-in-space nature 
of most processes: communication lines, three dimensional plants, transporta- 
tion systems and so on. In many cases, spatial discretisation (finite elements, 
finite differences) allows us to set up approximate models, allowing us to better 
accept this assumption. 

Example 1.2. The distillation unit is a highly non-linear process, if it is consider 
in the full range of operating options. But if we consider its evolution around some 
stable production, an approximate linear model can be set up to relate the effects 
of input variations on the internal variables. 

The distillation plant may also be considered as a typical distributed system. 
We can talk about the column temperature, but this temperature varies from point 
to point internally, as well as the temperatures of the metallic elements in the ex- 
changers. There are transportation delays and, for instance, the instantaneous col- 
umn inlet flow concentration and temperature is slightly different from those at the 
output of the mixer. Nevertheless, by either averaging values or making a spatial 
discretisation, a lumped parameter model will be useful. 



1.5 Control Aims 

Referring to a multivariable, multiple-input-multiple-output (MIMO) system 
where there are p-controlled variables, expressed as a vector y(t), and to- 
manipulated variables, u(t), and also considering a d-dimensional disturbance 
vector, d(t), the control requirements for following a /^dimensional vector 
reference, r(t), can be stated at different levels, as described below. 

Ideal control. If the relationship between the process variables can be ex- 
pressed by: 

y = Gu -\- Gdd (1.1) 

where G and Gd are general operators, the ideal control action, leading to 
y = r would be: 

u = G~ 1 {r-G d d) (1.2) 

This control could be perfect, but it is ideal and not achievable. There are 
many reasons for this, among them: 

1. The operator G is usually not invertible. 

2. Even if G were invertible, the resulting actions may be physically unfea- 
sible. 

3. The disturbance, d, may be unmeasurable. 

4. The process and disturbance models (G and Gd) are not perfectly known. 
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Possible control. For the control problem to be feasible, some performance 
requirements from the ideal one must be relaxed so that they are compatible 
with the constraints in the available actuator powers and measurements. For 
instance, high-speed reference tracking and low control action are not simulta- 
neously achievable. High attenuation of unmeasurable disturbances and high 
tolerance to modelling errors are also incompatible. So, the control design is 
a trade-off between conflicting requirements. Introducing additional sensors, 
actuators or control variables in a more complex control structure may im- 
prove the performance possibilities of the control system. Ideal control would 
be achieved under unlimited actuator power and full information sensing. 

Optimal control. If the requirements are formulated as the minimisation 
of a cost index or the maximisation of a performance index, the resulting 
controller is called an “optimal” one. But optimality from a mathematical 
viewpoint does not mean the best from a user viewpoint, unless user require- 
ments are properly translated into optimisation parameters (see below). 

Practical control. The controllers above are theoretical controllers. They 
are based on models and ideal performances. Other than the issues above, 
practical controllers should consider that: 

• the models represent an approximate behaviour of the actual process 
(sometimes very coarse) and this behaviour may change, 

• formal control design specifications represent user requirements only ap- 
proximately and partially, 

• the process operation should be robust against moderate changes in the 
operating conditions, requirements and disturbances, 

• the implementation of the controller is constrained to resources’ availabil- 
ity. 

Thus, practical controllers should prove to the end-users that they can con- 
sistently operate the process in an “automatic” way without the continuous 
surveillance of the operator. The complexity of the controller, the ease of pa- 
rameter tuning, the interpretability of the different control actions, or its cost 
advantages are issues to be considered when selecting a control strategy. 



1.6 Modes of Operation 

As previously mentioned, the dynamic behaviour of non-linear processes may 
be quite different depending on the operating conditions regarding loads, dis- 
turbances and references. But any controlled process may operate in a variety 
of situations such as starting-up/shutting-down, transferring from some oper- 
ating conditions to new ones, under constraints (alarms, emergency) or under 
the guidance of the operator. All this means different modes of operation 
requiring different control strategies. In some cases, the same controller but 
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with different parameters will be appropriate, but in some others new control 
structures or even no control at all may be needed. 

In fact, any automatic control system should have the option of operating 
in at least two modes of operation: 

• manual control, if the manipulated variables are determined by the op- 
erator, 

• automatic control, where the manipulated variables are governed by the 
controller. This can be done in two basic settings: 

open-loop control. There is no feedback from the process and the 
manipulated variables are determined by the control system based on 
the information provided by the operator or input measurements, 
closed-loop control. The controller determines the manipulated vari- 
able based on the references and goals introduced by the operator and 
the measurements from the process. 

Of course, mixed strategies do exist. 

One interesting practical problem is the transfer between modes of op- 
eration. In particular, “closing the loop” (as well as the transfer between 
operating conditions) is a difficult action requiring some expertise to avoid 
“bumping” and even instability in the process signals. 

Example 1.3. The distillation unit will be usually warmed up in manual mode. 
The different flows and actions will be updated manually to reach the operating 
conditions. Information from the unit will guide the operator (acting as a controller) 
to drive the unit close to the desired conditions, in an open-loop operation. Finally, in 
a gradual way, the control loops will be closed, starting with those more independent 
or less influential on the overall behaviour of the unit. 



1.7 The Need for Feedback 

The ideas above can be expressed in a general and obvious way: at any mo- 
ment, the appropriate control action depends on the situation of the process. 
To know the process situation implies getting some information from it: to 
close the loop [76]. 




Figure 1.3. Basic control loop 
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Let us consider a linear SISO system, with a closed-loop control as depicted 
in Figure 1.3, where n is a measurement noise. Assuming a sensor system 
operator H, and a reference filtering F, the output can be expressed by 2 : 

GK ,, GKH 

V = T^GKH Fr + 1 + GKH d - T^GKh" (13) 

Reference tracking, y = Tr, can be achieved in open loop {H = 0) with 
K = G _1 , if r is such that physical realisability constraints are avoided ( F 
may be a low-pass filter to achieve that) . 

However, feedback ( H ^ 0) is necessary for disturbance rejection. Oth- 
erwise, the effect on output will always be G^. Feedback is also needed to 
counteract modelling errors. In open loop, T a i — GK is achieved, and in 
closed loop, it is T c i = FGI\/( 1 + GKH). In many cases, a controller, K , 
can be designed so that T is any user-specified function. Let us depict the 
variations on the achieved behaviour with small variations of G: 

ST 0 i = K6G =► 6 ^f= S § 

AT - FK AG ^ S Ai - 1 SG 

cl (1 + GKH) 2 T cl 1 + GKH G 

so closed loop is advantageous if (1 + GKH) > 1, as it diminishes sensitivity 
to modelling error with respect to open-loop control. 

Thus, feedback is necessary and appears as a solution for basic con- 
trol problems such as disturbance rejection or reference tracking, also under 
modelling errors. In a first approach, if we consider a high-gain controller 
(I\ » 1), the above equation can be simplified to: 



(1.4) 

(1.5) 



y 



F 

—r + 0 a — n 
H 



( 1 . 6 ) 



Thus, some interesting conclusions about feedback are: 

• it works if the closed-loop system is stable (stable zeros of 1 + GKH), 

• the process and disturbance models (G and Gd) are irrelevant (insensitivity 
to modelling error), 

• it injects sensor noise and its imprecision as additional deviation sources, 

• for y to track the reference (F = H ), a precise knowledge of the sensor 
system (H) is required, 

• it (may) cancel the disturbances. 

However, lrigh-gain implies a greater chance of instability, and measurement 
noise must be filtered. A feedback control system is designed to achieve a 
compromise between disturbance rejection, noise filtering and tracking the 

2 Sometimes positive feedback is assumed, leading to denominator expressions in 
the form 1 — GK (see, for instance, Equation (8.16) on page 242). 
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reference, copying with some uncertainties in the models and guaranteeing 
some degree of stability. 

Similar concepts are applicable to MIMO processes, although the com- 
plexity of the operators requires a more careful treatment. 

Feedback control is based on the existence of an error or a discrepancy 
between the desired controlled variable and the corresponding measured out- 
put. By its conception, if there is no error no control action is produced. Thus, 
some kind of error should be always present. 

In order to act before an error is detected in the system, if there are 
measurable disturbances or planned changes in the references, a feedforward 
(anticipatory) control may be useful. A control action is generated to drive 
the process in the required way, trying to reject the measurable disturbances 
and “filtering” the reference changes. Ideally, if the control given by (1.2) is 
applied, no error will appear. But this is not achievable in general. Thus, even 
in the case of feedforward control, a final feedback or reaction based on the 
knowledge of what is happening in the process is needed. 

A more complete solution is to combine both structures to get a so-called 
two degree of freedom (2-DoF) control configuration. It is worth pointing 
out that the loop controller should take care of both the model uncertainties 
and the unmeasurable disturbances. The prefilter can implement a sort of 
open-loop control. The idea of reference prefiltering can be also extended to 
measurable disturbances, leading to additional feedforward control schemes. 



1.8 Model-free vs. Model-based Control 

Abstraction is a key feature of control engineering. To realise that the dy- 
namic behaviour of an aircraft can be represented with the same tools, and 
even equations, as a distillation column provides a platform to conceive con- 
trol systems in a generic way. But this common framework for representing the 
dynamics of different processes does not mean that the particular character- 
istics of any process are included in the generic model. First, remember that 
a model is always a partial representation of a process. Second, it is worth re- 
membering that the requirements, constraints, operating conditions and many 
other circumstances may be very different from one system to another. 

There are two basic approaches to getting the model of a process. On 
one hand, if the process is physically available and some experiments can be 
carried out, its dynamic behaviour can be captured and (partially) represented 
by a model, using “identification” and “parameter estimation” techniques [84] . 
On the other hand, if the operation of the process is fully understood and the 
governing principles are known, a first-principle model can be drawn, although 
some experiments should be carried out to determine some parameters. 

A model-based control may be developed and, in this case, the main steps 
in the design will rest upon the mathematical treatment of the global closed- 
loop model [41]. 
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Model-free control. In some cases, the control design is based on the emu- 
lation or repetition of some actions that have been proved to be appropriate. 
No model of the process is needed but it is required to deal with processes 
with similar behaviour. Also, by some experimental approach (or even by 
trial and error), some parameters of a given controller may be tuned to get 
the appropriate behaviour. 

If many sensors and actuators are cleverly located (in a suitable control 
structure), successful on-line tuning of simple regulators may be carried out. 
However, a basic model is needed to understand the suitability of the different 
instrumentation alternatives . 



1.9 The Importance of Considering Modelling Errors 

It has been pointed out that a process model (system) is a partial represen- 
tation of the process behaviour. The partial concept may refer to: 

• some phenomena and/or variables have not been considered or, even if 
considered, they have been deemed as irrelevant. This results in a simpler 
model, a reduced model involving less variables or less complex equations 
(lower order in the differential equations), 

• the model has been obtained under some operating conditions not rep- 
resenting the process behaviour in other situations where, for instance, 
the timescale, the frequency range or the magnitude of some variables is 
different or the presence of disturbances was not taken into account. 

In this context, it is usual to consider local models (around given set-points 
or operating conditions), different timescale models (to analyse the transient 
or the steady-state behaviour) or low/lrigh-frequency models. 

Thus, a model should have some properties attached, such as its validity 
range, the parameters’ accuracy or the uncertainty introduced by the missing 
dynamics, in order to be properly used. 

It is worth mentioning that the quality of a model is strongly connected 
to the purpose of its use [52] . It is not the same to have a good model to fully 
design a distillation column, to understand its behaviour at a basic level or 
to design a control system for it. For these three different uses, three different 
models may be appropriate. 

^From a control viewpoint, some apparently very different process models 
may lead to the same controller and, vice versa, two slightly different models 
may behave in a totally different way if the same controller is applied to them. 
So, the importance of modelling error depends on the conditions of use of the 
model. 

Example 1-4 ([16]). Let us consider two SISO systems represented by their transfer 
function (TF) : 

Gi(«) = = 



(0.95s + l)(0.025s + l) 2 



(1.7) 
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The reader can easily check that the open-loop step responses are almost identical. 
However, with a proportional regulator, k = 85, the first system exhibits a wonderful, 
desirable, closed-loop step transient but the second one is unstable. 

If the models to be compared were: 



Gi(s) 



1 

s + V 



G 3 (s ) 



10(s + 1) 
s(10s + 1) 



( 1 . 8 ) 



the second one is unstable in open-loop response. However, the behaviour with the 
above mentioned proportional regulator yields a very similar response in terms of 
settling time and final value. 



Thus, in modelling a process, the control purpose should be kept in mind. 
Identification for control is the identification approach trying to get the best 
process model to design the control and, moreover, to combine the efforts of 
modelling and control design in the common endeavour of getting the “best” 
controlled system behaviour. 

In this framework, the concept of robustness appears as a fundamental 
property of a practical control system. It does not matter how good a control 
system is if slight changes in the process/controller parameters or in the op- 
erating conditions result in a degraded control or even in unstable behaviour. 

And it does not matter if the controlled plant behaves properly under many 
operating conditions if it fails to be under control or violates some constraints 
in some specific (possible) situations. 



1.10 Multivariable Systems 

If p-independent variables are selected to be controlled, then at least the 
same number of independent variables should be manipulated (m > p). Being 
independent means that they do not produce similar effects on the controlled 
variables, although the concept will be later formalised. If there are more 
manipulated than controlled variables, then there are more options to control 
the process and it is expected to achieve better performances. In general, the 
number of sensors need not be equal to the number of controlled variables p: 
as in the case of actuators, the more sensors, the better. 

In dealing with multivariable systems, some extra concepts are relevant: 

• grouping (subdivision) and pairing. In principle, one or more inputs 
may be “attached” to each controlled variable or group of them. The choice 
of groups influences: 

interaction. The manipulated variables attached to one controlled 
variable may affect the others, 

dominance. If the effect of the corresponding attached manipulated 
variable is greater than the others, the coupling presents dominance. 
The concepts of “greater” effect is, at this moment, qualitative. Later 
on it should be more precisely formulated, 
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• conditioning. Refers to the different “gains” a multivariable process may 
present according to the combination (direction) of inputs. If they are 
significatively different, the process is ill conditioned and it may be difficult 
to control. 

The magnitude of all these coupling effects is strongly dependent on the mea- 
surement units. Thus, an appropriate scaling is always necessary so that all 
errors have comparable meaning. 

In some cases, the selected manipulated variables and measurements will 
not appear to be convenient for control purposes and changes in the number 
and/or position of the actuators and sensors will be required. 

In a multivariable control problem, the pairing of input/output variables, 
the effect of the interactions and the options for decoupling different control 
goals are issues to be considered at the earlier stages of the design [119, 46]. 



1.11 Implementation and Structural Issues 

Although there are still many control systems based on pneumatic, hydraulic, 
electric or electronic components, most of them are implemented digitally. The 
operational amplifier has been the kernel of many control devices, but nowa- 
days digital control technology is considered as the general implementation 
technology. 

Thus, even if the controlled plant is a CT system, the controller is a DT 
one. If the sampling period is short enough, most of the CT techniques can be 
directly translated into DT implementations, but, if this is not the case, inter- 
sampling behaviour and performance degrading should be taken into account. 
Otherwise, pure digital control design techniques should be used. 

Digital control simplifies the control implementation. At the end, the con- 
troller device is implemented as an algorithm, a small part of the application 
code. The same computer can be used, without additional cost, to implement 
many controllers. This involves not only specific hardware such as reliable 
computers and communication networking, but also a real time software to 
guarantee the actions delivering time. Also, in the case of MIMO systems, 
the dynamics of all the controlled variables is not necessarily the same, thus 
requiring different time scheduling. But due to the resources limitation there 
are a number of issues to be considered: 

• word-length. Both the variables and the coefficients are discretised and 
represented by finite-length string of characters. The computation accu- 
racy is bounded, 

• time constraints. The same CPU must run a number of different tasks and 
the time available for each task is limited, 

• reliability. The failure of a task may affect the execution of a critical one. 

DT control implementation may be centralised or decentralised. In the first 
case, all the data are processed by a unique CPU producing the control signals 
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for all the manipulated variables. Reliability, networking and task scheduling 
are the main issues. In decentralised control, each control loop may be allo- 
cated to a digital unit, but still a lot of networking and real time scheduling 
is required to coordinate the behaviour of the whole system. 

One additional feature of digital control is the ability to easily combine 
the control tasks at different levels: local regulation, coordination, supervision 
and operator interaction. In this setting, binary logic decision systems are 
coupled with the lower level controllers, leading to hybrid complex systems. 



1.12 Summary of the Chapters 

The previous sections have outlined the problems to be solved in designing a 
multivariable control system, from the conception, the modelling and simula- 
tion phase to the implementation. A deeper understanding of them and their 
solutions is the objective of the rest of the book. As described in the Preface, 
the book is organised in a set of main chapters covering the main topics and a 
set of appendices where revision of concepts or more involved details on some 
techniques are placed. 

The next chapter discusses the different model types available and the 
transformations between them. Chapter 3 details analysis of the system prop- 
erties that can be inferred from their models (gain, stability, structure) . Chap- 
ter 4 describes in more detail the objectives of control and the alternatives 
in solving the associated problems briefly outlined in this introductory chap- 
ter (closed-loop properties, feedforward control, etc.). Chapter 5 presents the 
methodologies for controlling MIMO plants based on SISO ideas by setting 
multiple control loops, decoupling and creating hierarchies of cascade control. 
Chapter 6 describes some centralised control strategies, where all control sig- 
nals and sensors are managed as a whole by means of matrix operations. Pole 
placement state feedback and observers are the main result there. Chapter 
7 deals with controller synthesis by means of optimisation techniques. The 
linear quadratic Gaussian (LQG) framework and an introduction to linear 
fractional transformation (LFT) norm-optimisation (mixed-sensitivity) are 
covered. Chapter 8 discusses how to guarantee a certain tolerance to mod- 
elling errors in the resulting designs. It deals with the robustness issue from 
an intuitive framework and presents the basics of robust stability and robust 
performance analysis. Mixed sensitivity is introduced as a methodology for 
controller synthesis. Lastly, Chapter 9 deals with additional issues regarding 
implementation, non-linearity cancellation and supervision. 

The appendices are devoted to review basic concepts on SISO, matrix anal- 
ysis and signal and system norms, including also some technicalities about op- 
timisation (derivation of the linear quadratic regulator equations), stochastic 
processes (derivation of the Kalman filter) and providing additional informa- 
tion on robust control methods. 
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Linear System Representation: Models and 
Equivalence 



In this chapter, models used for system simulation and model-based control 
design are presented. The treatment is focused on linear systems and the lin- 
earised approximation of non-linear systems due to the necessary limitation in 
space. As disturbance rejection is a key objective in many control applications, 
disturbance models are also introduced. 



2.1 Introduction: Objectives of Modelling 

In the previous chapter, it was shown that the “ideal” control requires the 
inversion of the plant model. Thus, any control structure will take advantage 
of a good process model to compute the control action, even if the model is 
not perfect. 

In this book, process models are tools for designing the control system, 
for simulating the behaviour of the controlled system, and for analysing its 
properties and evaluating the goals’ achievement. Thus, their level of detail, 
range of validity and presentation will be determined by their use. 

For each application, control goal or design methodology, a given model 
will be more or less suitable. Given a process, different models can be attached 
to it, some of them being equivalent, but, in any case, all them should be 
“coherent” [84]. 

For instance, for regulatory and tracking purposes, a CT/DT dynamic 
model would be required, but for production optimisation or management a 
simplified and aggregated model, or even a steady-state model, would be more 
appropriate. For alarm treatment, a discrete-event model will represent the 
evolution from one operating condition to the next, probably combined with 
some regulatory actions. 

State-based models will be extensively used in this book, due to their 
relationship with first-principle models and their ease of computer implemen- 
tation, as well as the availability of computer aided control system design 
packages for them. 
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Other than processes, signals should be also modelled. They can be consid- 
ered as the output of processes (generators) with some particular properties. 
In particular, deterministic disturbances (such as steps, ramps or sinusoidal 
variations) can be modelled as the output of uncontrollable generators, and 
stochastic disturbances will be mainly modelled by their mean and variance 
properties. 



2.2 Types of Models 

As previously mentioned, based on the type of signals involved in the model 
we can find models of different natures: CT, DT, discrete-event, hybrid or 
stochastic models. 

The usual CT and DT signals are functions of time, as defined in Appendix 
A.l. Multivariable signals are composed by stacking a set of individual signals 
in column vector form. 

A binary or logical signal only takes two possible values, being synchronous 
if changes are only allowed at predefined time instants or asynchronous if the 
changes may happen at any moment. 

Random variables and stochastic processes, being characterised by their 
statistical properties, will be considered in a later section and in Appendix E. 

Although different kinds of models can be defined, unless otherwise stated, 
the hypothesis of Section 1.4, namely linearity, time-invariance and lumped 
parameters (finite-dimensional system), will be assumed to hold. 

A non-linear system is a broader (and more common) representation of 
actual processes. The diversity of options and their specific and usually more 
difficult mathematical treatment puts the study of non-linear systems out of 
the scope of this book. Some simple cases will be outlined in Section 9.5. 
non-linearity, time-variation and spatial variation will be accommodated by 
control systems that are tolerant enough regarding modelling error. 

Locality. The models usually only represent the relationship between incre- 
ments of the variables around a given operating point This is quite usual in 
modelling non-linear systems if we are interested in their approximate lin- 
earised behaviour around an equilibrium point. In general, non-linear models 
are better suited to modelling the global behaviour of a process, relating ab- 
solute values of the variables. 

Variables. Based on the kind of variables involved, we can define: in- 
put/output or external models, and state variables or internal models. In the 
case of external models, we can also consider the so-called black-box models, 
where only the input and output variables are involved, or white-box models, 
where the internal structure of the process is somehow represented. 

Methodology. The last distinction can be also related to the approach fol- 
lowed to obtain the model. If the basis of the process operation is known, 
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its dynamical behaviour can be expressed by balance and fundamental equa- 
tions, leading to a first-principle model. If, on the other hand, this fundamental 
behaviour is unknown or the resulting equations would be too detailed and 
complicated, and it is possible to experiment with the process, its response 
to some excitation can be used to get an experimental model representing its 
input/output behaviour, without any reference to what happens internally. 



2.3 First-principle Models: Components 

Let us consider the following illustrative example. 

Example 2.1 (First-principle modelling). Let us consider a continuous-flow stirred 
tank reactor (CSTR) 1 , where a first-order exothermic reaction A — * B happens, with 
a cooling jacket [89]. We have a rough model of the CSTR, knowing that due to the 
entrance of a flow rate input stream, F 0 , with C ao concentration of component A, 
at a temperature T 0 , there is an internal level, h, temperature, T, and component 
A concentration, C a , and there is an outlet flow rate, F, at temperature T and 
concentration C a . This can be represented by the block shown in Figure 2.1, where 
the cooling jacket water flow, Fj, enters at temperature Tj 0 , leaving at temperature 
Tj, and the total jacket volume, Vj . is fixed. 




If all the processes inside the reactor are known, the following set of equations can 
be written: 



1. Total mass balance: 

2. Mass balance on component A: 

d{VC a ) 



dV 

dt 



= F 0 -F 



dt 



= FoCao - FCa - aVCae-Ttr 



(2.1) 



(2.2) 



where R is the perfect gas constant and a is the pre-exponential factor from the 
Arrhenius law, and E is an activation energy. 

The work about this process has been carried out in collaboration with M. Perez 

[ 101 ]- 



1 
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3. Energy balance in the reactor: 



dT 

dt 



F 0 T 0 — FT 
V + 



Ha ^ __e_ 



pc P 



C a e * T 



UA 

pc p V 



(T-Tj) 



(2.3) 



where H is the reaction heat, p and c p are the density and heat capacity respec- 
tively of the inlet and outlet streams, U is the overall heat transfer coefficient 
through the jacket, A is the transfer area. 

4. Energy balance in the jacket: 



dt 




Tj) + 



UA 

Pi c pi Vj 



(T-Tj) 



(2.4) 



where pj and c p j are the density and heat capacity respectively of the cooling 
stream. 



In this way, a set of non-linear differential equations represents the CSTR dynamics. 

Simplifications. If we were only interested in the reactor components evolution, 
or the reaction were isothermal, the energy-balance equations would be missing: 

d ^ =Fo _p = (FoC ao - FC a ) - aVC a e~vr (2.5) 



Temperature variations, if any, would amount to having time-variance in the pa- 
rameters on the reduced model. 

If interest were focused on long-term production, only the static relation among 
the variables would be relevant. Then, for given input constant values, if the opera- 
tion is stable, an equilibrium point will be reached and a set of (algebraic) equations 
will model the steady-state behaviour. Steady-state equations are obtained by set- 
ting to zero all derivatives (as magnitudes are constant): 



F = F a - 
y(To~T) + 



El 

Vi 



(T jo 



F 0 (Cao - Ca) - aVC a e~RT = 0 

—C a e~^r - JEA(T- Tj ) = 0 

pc p PCp v 



Tj) + 



UA 

Pi c pi Vj 



(T — Tj ) ==■■ 0 



( 2 . 6 ) 



Similar to the reactor equations, basic equations describing the elements’ 
phenomena can be used. We distinguish between static elements, leading to 
algebraic equations, or dynamic elements. 

Static elements. Examples of static behaviour are, for instance: 



• resistors: V = I R, 

• wall heat transmission: Q 12 = k(T\ — T2), 

• springs: / = K(l - Z 0 ), 

• outlet flow: F 12 = ky/h, 

• pipes: F = k(P\ - P 2 ), 

• viscous friction: / = kv, 

• balances, such as: 

fi = 0 - the total force applied to a body, 
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"22 Fi = 0, the net flow in a pipe junction if there is no storage, or 
Y2 Vi = 0 the total voltage drop in a loop, and so on. 

The meaning of the different constants and parameters is clear for those in- 
troduced in the respective field. Some of these expressions are approximations 
of non-linear relationships (friction, spring, resistor) but some others, like the 
tank outlet flow, are explicitly non-linear. Under some circumstances, a linear 
approximation will be possible. 

Dynamic elements. Dynamic elements are those where the involved vari- 
ables are not related instantaneously but in different times or by time incre- 
ments. For instance, accummulative or delay components, such as: 

• capacitors ^ I ) aud coils = -yU), 

• heat storage: ^ - Q ou t ), 

• mass storage: ^ = jj( F in ~ F out ), 

• motion equations: acceleration ^ fy = yT res , or velocity ^ = 

v, ^ = tv for linear or angular motions, 

• chemical reactions: ^ as previously used, where the product 

composition evolves with time, 

• transportation belt: m ou t(t) = m.i n (t — r), 

• stack or queue systems: n(k + 1) = n(k) + ^ Ui(k). 

We must notice that these relationships (and many others) are similar, leading 
to a component behaviour that is common to some of them. These analogies 
allow for a unified treatment of any dynamical system without much relevance 
of the supporting technology. It should be pointed out that the last dynamic 
equation is slightly different, as the time is discrete and the variables are 
assumed to be integers. We will see more of that later on. 

Basic equations. The equation 

^ (2.7) 

represents the storage of u, a being a scaling constant to deal with the ap- 
propriate measurement units of y and u. In fact, the same relationship can be 
written as: ^ 

y(t) = a u(t) dr + y{ 0) 

Jo 

The equivalent DT equations would be, respectively: 

k - 1 

y(k + 1) - y{k) = au(k) y(k) = a ^ ui + y(0) (2.8) 

i = o 

In DT it is also very easy to represent some delays such as: 




22 



2 Linear System Representation: Models and Equivalence 



y(k ) = u(k — d) (2-9) 

where d is the number of time delay intervals in this relationship. 

These storage and delay equations are the basic dynamic equations and 
will be the kernel in defining the state space model in the next section. 



2.4 Internal Representation: State Variables 

A process is composed of a number of interconnected elements as described 
above. In order to completely define a process model, we must get the same 
number of independent equations as internal variables, allowing theoretically 
the computation of the internal variables given the external input, u(t) . 

Some of the equations in the model will be dynamic and some of them will 
be algebraic. By substitution, some equations can be removed. A so-called 
normalised representation can be obtained by removing the algebraic equa- 
tions and manipulating the rest of them to be expressed as storage equations 
(2.7) or (2.8). 

State equation. If all the dynamic equations are first-order differential equa- 
tions, they can be arranged in a normalised way. Denoting by state variables 
the storage variables previously defined, the process model could be sum- 
marised by the so-called state equation: 

^ = f(x(t),u(t),t) (2.10) 

where x £ K™ is the state vector, u € R m is the input vector and / is an 71 - 
dimensional vector of non-linear functions. The argument t explicitly indicates 
the possibility of being time- varying functions. This system representation is 
denoted as being an n-order system. 

Output equation. If the output variables, y £ R p , are not the state vari- 
ables, they will be related to them, and possibly also the inputs, by the (al- 
gebraic) output equation: 



y{t ) = 9 (x{t),u{t),t) 



( 2 . 11 ) 



where g is a p-dimensional vector of non-linear functions. The set of state and 
output equations is denoted as a system realisation or normalised state space 
representation. 



Example 2.2. Looking at the equations in Example 2.1, let us rewrite the model as 
state equations. Only Equation (2.2) should be transformed into: 



dC a 

dt 



Fo(C ao — Co) 
V 



aC a e 



the rest of the equations, (2.1), (2.3) and (2.4), constituting a fourth-order system 
with states ( V , C a , T, Tj). 
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For DT processes, the state and output equations will be, respectively: 

x(k + 1) = u(k), k) (2-12) 

y(k) = g(x(k),u(k),k) (2.13) 

where the argument k stands for the integer instant of time. 

The delay element, (2.9), in CT models requires an infinity of state 
variables to be represented (all the past input values), leading to infinite- 
dimensional systems. Some approximations are usually done, (2.42). 

However, in a DT process, if the time delay is a multiple of the period, 
it will admit a simplified treatment introducing as many delayed variables as 
delay intervals. For instance, for d = 2, y(k) = u(k — 2) is equivalent to: 

xi(k + 1) = X 2 (k)] X 2 (k + 1) = u(k)-, y(k) = x\{k) (2-14) 

The Concept of State 

The previously defined state variables have a number of interesting properties: 

• memory. They summarise the past history of the process, 

• state as internal variables. They are not directly connected to the 
input, but their derivatives (in DT, future values) as well as any other 
process variable can be expressed as a function of these and the inputs, 

• minimality. There is a minimum number of state variables so that the 
process internal model cannot be further reduced by removing any internal 
variable; otherwise, the dynamic equations will be of an order higher than 
one, 

• non-uniqueness. Any set of n-independent internal variables, not directly 
connected to the input, represents the system. By independent we mean 
each one representing a different storage process. 

If the set vector x(t) is a state vector, any variable vector x(t) such that 

x(t) = Tx(t) (2.15) 

T being an n-square regular matrix, is also a state vector. 

Indeed, knowing x(t ), the new state can be computed as x{t) = T~ l x{t) 
and viceversa (2.15). The T-matrix represents a linear state transformation 
or a similarity transformation. The transformation of Equation 2.10 yields: 

< ^ = T- 1 f(Tx(t),u(t),t) 

so it is also a normalised representation. 
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2.5 Linear Models and Linearisation 



As previously mentioned, most of our study is referred to linear, time-invariant 
(LTI) systems. For this kind of systems, the state equation (2.10) is simplified: 
the time variable is no more an argument (time-invariance) and the functions 
/ express linear combinations of the state and input variables. Thus: 

^ = anX\ + 012^2 + • • • + a i n x n + bnU\ + • • • + bi m u m 

: (2.16) 

“f f- = dnlAl + a n 2X2 + • • • + a nn X n + b n lU\ + • • • + bnmUm 

or, in matrix form 

x(t ) = Ax(t) + Bu(t) (2-17) 

Similarly, for the output equation (2.11), it would be: 

yi = ciiaq + Ci 2 :r 2 H h c ln x n + dnu 1 H 1- d lm Um 

(2.18) 

yp Cpi'E 1 + Cp2*^2 T * * * T Cp n x n dpi'Ui T * * * T dp 7 n u rn 

or, in matrix form: 

y(t) = Cx(t) + Du(t) (2-19) 

The state space model involves the four matrices (A, B,C, D) having the 
following dimensions and meaning: 

• A, the n x n system matrix, represents the internal interconnection among 
state variables, 

• B, the n x m input matrix, represents the input-to-state direct connection, 

• C, the p x n output matrix, represents the state-to-output direct connec- 
tion, and 

• D, the p x m coupling matrix, represents the input-to-output direct con- 
nection or input/output coupling. 

So, in total, the number of parameters is n 2 + n x m + p x n+p x m. A system 
will be denoted by the 4-tuple shorthand notation S := (A, B , C, D). 

It is easy to show that under a similarity transformation such as (2.15), 
the new equivalent state space model will be (A, B , C, D ), being: 

A = T~ 1 AT; B = T~ 1 B\ C = TC; D = D (2.20) 

and the new state and output equations: 

x = Ax + Bu 
y = Cx + Du 

Some transformations are of special interest for deriving or emphasising some 
properties of the representation, denoted as canonical representations, usually 
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reducing the number of significant parameters. For instance, if the eigenvalues 
of A are distinct, it is possible to find a matrix T such that A = A is diagonal 
(or, in a general case, a Jordan canonical form). Appendix B details some 
essential definitions and properties regarding matrices. 

If we want to make a distinction between manipulated and disturbance 
inputs, a generalised state space model can be expressed by: 

x(t) = Ax(t ) + Bu(t) + B d d(t) (2-21) 

y{t) = Cx(t) + Du(t ) + D d d(t) (2.22) 

where d £ R 9 is a g-dimensional vector of disturbances. 

Equilibrium points. Under some conditions, the non-linear model (2.10 
and 2.11) can be approximated by a linear one, in particular, around an 
equilibrium point. For a constant value of the input vector, ir , an equilibrium 
point is defined as the state vector (set of variables), a; 0 , solution of: 

0 = /(x, u°) (2.23) 

It is worth noting that for the same input u° there may be one, none or 
many solutions of (2.23), and thus, there will be the corresponding number 
of equilibrium points. 

Any other process variable will reach a steady-state value. For instance, 
the output vector will be: 

y° = g(x°,u°) (2.24) 

Note that the equilibrium point can be stable or unstable. Further detail will 
be given later. 

Linearisation. If the vector functions in the non-linear model, / and g , are 
continuous and derivable at an equilibrium point (x°,u°), a linearised model 
can be attached to the process by means of a truncated Taylor series expansion 
of these functions. 

For small input amplitudes, the second and higher-order terms are negli- 
gible, and an approximate linearised process model in the form (2.17)-(2.19) 
can be derived: 

x = Ax + Bu ; y = Cx + Du 

where x = x — x° and u = u — u° represent the variable increments around 
the equilibrium point, and the elements of the corresponding matrices are the 
Jacobian components of the non-linear functions: 

a.ij = -^A{x 0 ,u°) i,j = l,...,n (2.25) 

dXj 

hj = ^A(x°,u°) i = l,...,n j = l f ,..,m (2.26) 

duj 

c ij = ^\ x °^°) i = l,...,p j = l t ...,n (2.27) 

j dgi . 0 

dij = -^-{x ,u ) i = l,...,p g = 1, ... ,m 



(2.28) 
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Remark 2.3. If the process evolves to another equilibrium point, the linearised 
model parameters change. If the variation in the variables is large enough to 
invalidate the lrigher-order terms’ truncation, the linear model is not valid 
anymore. 

Example 2-4- Let us consider the CSTR of Example 2.1. Assume a constant volume 
inside the reactor (F„ = F), as well as the nominal conditions and parameters in 
Table 2.1. 



Table 2.1. Reactor notation and steady-state variables. 



Variable 


Description 


Value 


c a0 


Input concentration (kmol A/m 11 ) 


8 


V 


Reactor volume (m 3 ) 


1.36 


T 0 


Inlet flow temperature (K) 


294.7 


Vj 


Jacket volume (m 11 ) 


0.085 


a 


Arrhenius exponential factor (h~ 1 ) 


7.08 x 10 1U 


E 


Activation energy (kj/kmol) 


69815 


U 


Heat transmission coeff. (kJ/hm 2 K) 


3065 


A 


Heat transmission surface (m 2 ) 


23.22 


Tjo 


Cooling water input temperature (K) 


294.7 


R 


Perfect gas constant (kJ/kmolK) 


8.314 


H 


Reaction heat (kj/kmol) 


69815 


cp 


Thermal capacity (kJ/kg-K) 


3.13 


CPj 


Water thermal capacity (kJ/kg-K) 


4.18 


r 


Reactive and product density (kg/m' 1 ) 


800 


rj 


Water density (kg/m 3 ) 


1000 



Substituting the data in the table into (2.2)-(2.4), the particular model is: 
^2 = _^(g _ Ca ) - 7.08 x 10 w C a e~ S397 - 3 ' T 
F- = -^(294.7 -T) + 197.4 x lO^Ca-e -8397 ' 371, - 20.8987(T - Tj) 

CLL -L . OO 

dT F 

~dt = 0T85 (294 ' 7 " Tj) + 20a3076 ( T - T i) 

Thus, the state equation with x = [ C a T Tj]' , and u = [F Fj ]'] would be: 

Xi = fi(x, u) = 0.7353ro(8 - xi) - 7.08 x lO^zie " 8397 ' 37 * 2 
X 2 = f 2 (x,u ) = 0.7353iti (294.7 — * 2 ) + 197.4 x iO 10 e ~ 839r - 3 /^ _ 20.90(a:2 - * 3 ) 
*3 = fs ( x ; u) = 11.76it2(294.7 — * 3 ) + 200.31(22 — 23 ) 

The operating point is defined assigning, for instance, the inlet flow F 0 = 1.13 
m 3 /h and cooling flow in the jacket Fj = 1.41 m 3 /h. Thus, the operating point, 
denoted by x s , can be computed by solving the above system equation, making the 
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left-hand derivative terms null as in (2.6). Due to the non-linearity, in this case there 
are three equilibrium points. One of the options is: 

x a = [C aa T s T ja f = [4.031 333.6 331.4] T 

The Jacobian elements, ciij = J| t (x s ,u s ), of the linearised model can be easily 
computed. For instance, the first linearised equation is: 

^ = — (0.7353rtis + 7.08 x 10 lo e“ 8397 ' 3/a:2s )®i 
+(-7.08 x 10 lo a:i s e" 8397 - 3/il:2 ' ! 839 J' 3 )x 2 + 0.7353(8 - xi s )ui 

x 2s 

Proceeding with all the elements, the following linear model is obtained: 



/ -1.705 


-0.2519 


0 \ 




/ 2.918 


0 \ 


23.088 


-28.71 


20.9 ; 


B = 


-28.6 


o 


V o 


-200.3 


-216.89 / 




V o 


-415.29 / 



Using the Matlab® command 2 ss, assuming C = I, that is, all the state compo- 
nents are measurable, and putting D = 0, the state space representation is created: 

sys=ss(A,B,C,D) 

The individual matrices can be retrieved as sys.a, sys.b, etc., if needed. 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: gradient ,diff , ss. 



Remark 2.5. A linearised model can also be obtained around a nominal tra- 
jectory. If the system input is defined in a time interval, it°(t),Vf € 
and the nominal state trajectory is given by a linearised model can be 

attached to this nominal trajectory by relating the variations of the trajectory 
with respect to variations of the nominal input. Nevertheless, the linearised 
model would be, generally, time-varying, as the linear model will change with 
the state 3 . 

A good example of this situation is a web treatment station, quite common 
in the plastic, paper, metallurgical and many other industrial sectors. The web 
is transferred from a coil to another one through the treatment area. The basic 
goal is to control the rotational speed of the leading shaft as well as the position 
of the tensional arm to keep a constant web velocity and tension. Under 
nominal operating conditions, the diameter and inertia of the leading coil are 
increasing with time, thus the nominal values of the parameters change. The 
nominal shaft speed is time-varying to keep the web velocity constant, and a 
linearised model can be obtained around this reference. 

2 All the commands in this book refer to Matlab® version 5.3. 

3 In fact, the Jacobian coefficients in (2.25) would be like: a.ij(t) = §^r( x °(t), u°(t)). 
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Advantages and drawbacks. The state space representation has the fol- 
lowing advantages: 

• it may be obtained by the process behaviour description, as realised with 
the reactor example, with an immediate physical interpretation, if so de- 
rived, 

• it presents separately the input effect and the measurement system, 

• it is valid for linear and most non-linear systems, 

• it can also represent the action of external disturbances (they are just 
treated as non manipulated inputs), 

• it provides the full (internal) description of the process, allowing the linking 
of the model with the internal structure, 

• there is a bunch of control system design approaches based on this repre- 
sentation, 

• it is valid for SISO and MIMO systems, with many common properties. 
One key point in the MIMO case is that a complex system of interactions 
is described with the minimal set of independent variables. 

But also, some drawbacks should be taken into account: 

• the model may be over-parameterised with respect to other representa- 
tions, 

• it is not unique and it may be unnecessarily complicated (i.e., over- 
dimensioned), if irrelevant physical phenomena are modelled or a non- 
minimal representation is used, 

• the frequency response is not easily connected with the parameters of the 
model, 

• delays cannot be modelled in the normalised representation, only approx- 
imately, by (2.43). 

Anyway, it will be shown that it is possible to get this representation from 
any other, and to transform it to any other as well, at least in the linear case. 

Discrete Models 

If instead of differential equations the process is defined by difference equa- 
tions, a discrete state space model can be used. In this case, the state and 
output equations are, respectively: 

x{k + 1) = Ax(k) + Bu(k) (2.29) 

y(k) = Cx(k) + Du{k) (2.30) 

Linearisation. Equilibrium points in non-linear discrete systems are cal- 
culated by replacing all instances of a particular variable, x (with different 
delays), with an equilibrium value, x°. For time-invariant DT systems, the 
equilibrium points are given by the solutions to: 

x° = f(x°,u°y, y° = g(x°, u°) 



(2.31) 
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Once the (non-linear) equilibrium points are calculated, linearisation is 
carried out obtaining the Jacobian, as in the CT case. 



2.6 Input/Output Representations 

In the previous section, we have built up a model by connecting the compo- 
nents according to the system structure, but it is also possible to look at the 
process as an m-input / p-output information processor. If only these variables 
are used, the system representation will be composed of a set of p-differential 
equations of order 1 or greater, as an extension of the differential equation 
model of a SISO system. An example of this is: 



Vi + 2y'i - 2/2 = 0.3ui + u\ (2.32) 

2/i + 2/2 = 2.5u 2 

This is a linear time-invariant CT two-input-two-output (TITO) system. 
Again, these differential equations could be non-linear and time-variant (even 
partial differential equations can be considered to represent distributed pa- 
rameter systems or oo-dimensional systems). For simplicity, we will assume 
the above equation system is formed by linear differential equations with con- 
stant coefficients. 

2.6.1 Polynomial Representation 

The Laplace transform (Appendix A) can be applied to the equation system, 
(2.32). If the terms involving the initial condition vanish or cancel, that is, if 
the initial variable values correspond to an equilibrium point of the system, 
an algebraic equation system on the Laplace variable, s, is obtained: 



s 2 2 /i(s) + 2syi(s) - y 2 = 0.3sui(s) + ui(s) 
syi(s) + s 2 y 2 {s) = 2.5u 2 (s) 



If the terms related to the same variable are put together, the model can be 
expressed by the following matrix equation: 



( (s 2 + 2s) -1) / 2/i( s ) \ _ ( (0.3s +1) 0 \ / ui(s) \ 
1, s s 2 )\y 2 {s))- V 0 2.5 )\u 2 {s)) 



(2.33) 



In a generic MIMO system, the model would be: 



D(s)y(s ) = N(s)u(s) (2.34) 

where D(s) and N(s) are polynomial matrices , with dimensions p x p and 
p x m respectively, whose elements are polynomials on the s variable. This 
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new model, (2.34), is called the differential operator model, as a result of 
the use of the s- variable, or polynomial representation. Instead of the four 
real matrices ( A , B, C , D) needed in the state space representation, only two 
matrices ( D 1 N) represent the system, although their elements are polynomials 
(see Appendix B.6). 

For a given system, the polynomial representation is not unique. In fact, 
if P(s) is a square, p x p, regular polynomial matrix, the process may be 
modelled by the new pair (£),7V), being: 



P(s)D(s) y(s) = P(s)N(s) u(s); => D(s) y(s) = N(s) u(s) 



Example 2.6. A trivial example would be, in (2.33), to multiply by: 



P(s) 




° ^ 

1 (s + 2 )J 



leading to an alternative representation of the same system with: 



D(s) 



(s 2 + 2s) 
0 



-1 

s 2 (s + 2) + 1 



;N(s) 



( (0.3s + 1) 0 \ 

\ —(0.3s + 1) 2.5(s + 2) ) 



The polynomial representation of DT models is similar, using the z- 
variable. 



Advantages and drawbacks. The polynomial representation also presents 
some properties. Among the advantages: 

• it relates the input and output variables, 

• it may be used to describe subsystems, 

• it may be obtained by linearisation of a set of non-linear differential equa- 
tions, 

• there are some ad hoc approaches to designing control systems based on 
polynomial operators, 

• the number of parameters is lower than in the state space model. 
However: 



• it is not unique, 

• it is not easy to handle (requiring symbolic computation and matrix in- 
versions), 

• it does not allow for easy autonomous system analysis (free response), 

• it is only valid for linear systems. 



2.6.2 Transfer Matrix 

From (2.34), assuming D(s) is invertible (i.e., the p-differential equations are 
independent), the output can be expressed as a function of the input: 

y(s ) = D~ 1 (s)N(s)u(s ) = G(s)w(s) 



(2.35) 
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The rational matrix, G(s) = D^ 1 (s)N(s), dimension p x m, is denoted as 
the process transfer matrix, and its elements are quotients of polynomials (see 
Section B.6). It is a function of the Laplace variable, s, and can be considered 
as an operator analogous to transfer functions in SISO systems. This is one 
of the most attractive properties of this representation. 

Example 2.7. In the example, (2.32), it is easy to obtain: 

(yi\ = ((s 2 + 2s) -n' 1 /(0.3S + 1) 0 \ /ui\ 

Vw V s s 2 ) V 0 2.5 )\u 2 ) 

and, for instance, using the Mathematica® language: 

GG=Inverse [{{s~2+2s , -1} , {s , s~2}}] . {{0 . 3s+l ,0} ,{0,2 . 5}-} 
it yields: 

a(0.33 + l) 2.5 

s a +2s 2 + l s 4 +2s a +s 
— (0.3s+l) 2.5s+5 

s a +2s 2 + l s a +2s 2 + l 

In this case, the system is represented by one p x m matrix, G(s), whose 
elements are rational functions. For instance: 



/ Ml 
V M2 



(2.36) 




Gijis) 



Vi{s) 

Uj(s) 



u{s)k=0,\/kjtj 



(2.37) 



is the SISO transfer function between the input, Uj, and the output, That 
is, the Laplace transform of the i-output over that of the j-input, assuming 
that the rest of the inputs as well as the initial condition terms are null. 

In general, p < m. That is, the number of output (controlled) variables is 
lower than the number of input (manipulated) variables. If p = m, G(s) is a 
square matrix and some matrix operations will be allowed. 

Again, the internal structure of the process is lost and this representation 
only provides information about the effect of the inputs in the outputs. If 
disturbances are considered, the model can be extended to become: 



y(s) = G p (s)u(s ) + G d (s)d{s ) (2.38) 

where d(s) is the Laplace transform of the vector of disturbances. Similarly, 
the element G di j(s ) is the transfer function between the ^-disturbance and 
the i-output. Equation (2.38) is equivalent to (2.21) and (2.22). 

Discrete case. The discrete transfer matrix representation of a general DT 
process, equivalent to (2.38), is expressed by: 



y{z) = G p (z)u(z ) + G d (z)d(z) 



(2.39) 
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Advantages and drawbacks. The transfer matrix representation presents 

a number of advantages: 

• it relates the input and output variables, 

• it may be used as an operator to combine subsystems, 

• it is unique (except for common factors in the rational elements, to be 
reduced) , 

• there are some ad hoc approaches to designing control systems based on 
this model structure, 

• the number of parameters is minimised, 

• its elements represent one-input to one-output connections, allowing ex- 
perimental identification and partial model validation. Although it is out 
of the main scope of this book, its importance should be stressed. Some 
options for these tasks are outlined in Appendix A. 4), 

• in the same way, it shows up the interactions among different inputs and 
outputs, 

• delays can be considered. 

However: 



• the elements are rational functions (including exponential terms if delays 
are considered), 

• some global system properties, easily derived from the state matrix A, do 
not appear so clearly, 

• it does not allow for the autonomous system analysis, 

• it is only valid for linear systems. 



Example 2.8. The internal representation of the CSTR, Example 2.4, is converted 
into a transfer matrix by the Matlab® command tf (or zpk to get it in factorised 
form), as shown in the following example: 



sys=ss(A,B,C,D) ; G=tf(sys); Gp=zpk(sys) 



TF from input 1 to output... 
2.918 (s+57.43) (s+190.6) 

# 1 : 

(s+1.83) (s+54.36) (s+191.1) 



From input 2 to output . . . 
2186.3814 

# 1 : 

(s+1.83) (s+54.36) (s+191.1) 



-28.6 (s+216.9) (s-0.6506) 

# 2 : 

(s+1.83) (s+54.36) (s+191.1) 



-8679.561 (s+1.705) 

# 2 : 

(s+1.83) (s+54.36) (s+191.1) 



5728.58 (s-0.6506) 

#3: 

(s+1.83) (s+54.36) (s+191.1) 



-415 . 29(s+28 . 49) (s+1.922) 

#3: 

(s+1.83) (s+54.36) (s+191.1) 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: ss , tf ,zpk, ss2tf , tf 2ss. 
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Systems with Time Delay 

Transportation phenomena, among others, introduce pure time delays in the 
relation between variables. If: 



y(t) = u{t - t ) (2.40) 

y(t) is a delayed version of signal u(t). In fact, if y(t) is the output and 
u(t) is the input of a system, this is a distributed process and the general 
mathematical treatment of this kind of system is rather complicated. 

On the other hand, the Laplace transform is easy to apply because: 

C[y(t)} = e~ ST u(s) 

In a delayed system, if the delays appear at either the input or output signals, 
it is quite common to model it by a transfer matrix. 

Example 2.9 (MIMO experimental identification). A mixing process (see Sec- 
tion 5.8.2 on page 162 for description and analysis of steady-state behaviour) has 
an intermediate buffer tank, a solvent valve and a pure-product valve. Outputs of 
interest are concentration (C, %) and flow ( F , 1/s). The experimental response of 
both outputs to a 10% valve opening on each valve is depicted in Figure 2.2. 






Figure 2.2. Mixing process: step response 



Applying experimental identification (Section A. 4), the following transfer func- 
tions can be approximately determined, targeting a widely-used first-order plus delay 
type of model: 
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F _ 5e _0 08s _ F _ 5 e _0 08s _ C _ 1.5e~ 0 06s . C _ -1.45e-°' 06s 

V a ~ 0.52s + 1 ’ Vs - 0.52s + 1’ Va ~ 0.17s + 1 ’ Vs ~ 0.17s + 1 

also depicted in the above figure in thicker line. Hence, the experimental transfer 
function matrix is: 

/ 5 e -0.08s 5e — 8,08s \ 

G(s) = Mfte. (2.41) 

V 0 . 173+1 0 . 173+1 / 

It is difficult to know if the initial response, heavily masked by noise, includes a delay 
or it is caused by high-order dynamics. So, there are fundamental issues regarding 
quality of the model, signal-to-noise ratio, etc. that may determine the success of 
multivariable control strategies based on this crudely approximate model: Chapter 
8 is devoted to them. 



Unfortunately, the delays do not always appear in such a neat form as 
in the above example because there are internal and crossed delays and the 
elements of the transfer matrix can also be complicated 4 . 

A general approach to deal with time delays is to use the Pade approxima- 
tion, converting the exponential into an approximated rational form. Based 
on the exponential approximation: 



e 



— TS 



62 - 



i ~ f s + V s2 + ■ • ■ 

1+ fs+ f s 2 + ... 



(2.42) 



the first-order approximation is: 



e 




(2.43) 



Higher-order approximations are more accurate but introduce additional com- 
plexity into the model. 

For DT representations, (2.9), if the time delay, r, is a multiple of the time 
interval in the elements of the sequence, r = dT , it can be transformed into a 
shift, or, in ^-transform, to multiply by the term z~ d , see Appendix A. 3. 



Transfer Matrix Poles and Zeros 



The elements of the transfer matrix are rational functions of the Laplace 
variable, s. For a transfer function, g(s) = , poles and zeros are the roots 

of n(s) and d(s) respectively (Appendix A. 2.1). 

The concept of pole and zero can also be defined for MIMO systems. 
Given a transfer matrix, extract the common denominator 



G(8) = 



N(a) 
d{s ) 



For instance, the closed-loop sensitivity function (4.5) of a SISO delayed system 
G = e~ s (s + 1) with proportional control k = 4 is (1 + fcG) -1 = ( - a+1 s ^ 4 e - a , so 
e~ s cannot be extracted as a factor. 
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where N(s) is a polynomial matrix and d(s) is a polynomial. Assume for 
simplicity that it has only single roots, d(s) = J~[iLi( s — Pi)- These are the 
poles of the system. In order to determine the pole’s multiplicity, decompose 
G(s ) into partial fractions by decomposing each element, = X)”=i 
Thus, by suitably arranging ajj . I in matrix form, we can express: 

71 AT 

G(s) = — ; rank(Ni) = m 

ti s ~Pi 



Then, the matrix rank n; is the multiplicity of the pole pi. 

Assume a square system, m = p for simplicity. In most cases, G(s) is 
regular, i.e., rank(G(s )) = m for almost all s. The MIMO system transfer 
matrix zeros are the values Zi such that rank(G(zi)) < m. 

Let us consider the following trivial examples: 

Example 2.10. 



G(s ) 



G(s) 

1 

s(s + 1) 




-1 s + l\ 

-(s+1) 1 ) 



1 

s 




+ 



s + 1 



1 0 
0 -1 



(2.44) 

(2.45) 



Thus, s = — 1 is a double pole and s = 0 is a single one. There are three poles at 
p — 0, —1, —1. For s — > 0, the transfer matrix 

lim G(s) = lim ( Ji f ^ 

s— >0 s— >0 V — 1 J 



loses the rank in one order. Thus, there is a zero at s = 0. 



Example 2.11. 




Thus, s = 0 is a double pole; z — —1 is a local zero for gn, but it is not a multi- 
variable zero, because rank(G(— 1)) = 2. On the other hand, it is easy to check that 
there is a multivariable zero at z = 1. 



In the next chapter, a more complete treatment of poles and zeros in MIMO 
systems, for any representation, is presented. 



2.7 Systems and Subsystems: Interconnection 

Between a detailed internal representation and a pure black-box one, a system 
may be represented by the interconnection of a number of subsystems. If the 
model of each element is known, a global model can be obtained. 

For example, in a control system, at least, two subsystems will always be 
considered: the plant to be controlled and the controller. The structure of each 
one may be also decomposed into a number of subsystems. 
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Figure 2.3. Series, parallel and feedback interconnection 



2.7.1 Series, Parallel and Feedback Connection 



Let us consider the basic subsystem interconnections. Let us define two sub- 
systems, in state space and transfer matrix form: 



Si- 



Xi — AiXi T BiUi 
Tji — C%Xi T DiUi 



Ui(s) = Gi(s)Ui(s) *=1,2 



(2.46) 



Assuming appropriate dimensions in the input and output vectors, y-i, a 
global system may be arranged with joint state vector, x = [xj x^] T , and its 
equation for each interconnection will be discussed. 

Series connection. Also denoted by cascade connection. The input/output 
vectors to each subsystem in Figure 2.3(a) are: 



y = y 2 ; u = «i; u 2 = yi 

This results in the global state space system: 

i =( B fc I ^) a:+ (s fi,)“ 

y = [D 2 Ci C 2 ]x + D 2 Diu 
and, in transfer matrix form: 



y(s ) = G 2 (s)Gi(s) u{s) 



(2.47) 

(2.48) 



(2.49) 



Parallel connection. The interconnection in Figure 2.3(b) is represented 
by: 

y = yi + 2 / 2 ; u\ =u 2 = u 
This results in the global system: 



A 1 0 

0 A 2 



B 1 
B 2 



y = [Ci C 2 ]x + {Di + D 2 )u 



y(s) = (Gi(s) + G 2 (s))u(s) (2.50) 
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Feedback connection. Figure 2.3(c). In this case, there is a loop and a 
summation point. Assuming an external input, v, null input /output coupling 
in the forward path (D i = 0) and negative feedback, the input /output vectors 
are: 

y = yv, m = v- y 2 \ u 2 = yi 

This results in y(s) = Gi(s)e(s) = Gi(s)(r — G 2 (s)y), so the global system 
can be written as: 



y(s) =(I + Gi(s)G 2 (s))~ 1 Gi(s)v(s) (2.52) 

In the last transfer matrix equation, the summation sign would be negative 
for positive feedback. 

A system may be composed of a number of such interconnections, leading 
to a complex model, where also disturbances can be present. In these examples 
of interconnection, the ease of use of the transfer matrix as an operator is 
clearly illustrated. 

Remark 2.12. In this and any other MIMO case, special care must be taken 
with block-diagram operations, as the matrix product is not commutative, 
contrary to the SISO case. 

2.7.2 Generalised Interconnection 




. { A\ — B\D 2 Ci —B\C 2 

x ~ V b 2Ci A 2 

y = (Ci 0)x 




Figure 2.4. General interconnections 



The interconnection between subsystems can be expressed in a general 
framework by just using two subsystems in a unique loop as in Figure 2.4 
(left), where the subsystem in the feedback has a transfer matrix M, and the 
one in the upper subsystem is suitably partitioned into four blocks, G n, G 12 , 
G 21 and G 22 . In this framework, the equations are: 

u 2 = My 2 = M(G 2l ui+G 22 u 2 ) => u 2 = (I - MG 22 )~ l MG 2 iUi (2.53) 
2/i = Gniii + G\ 2 u 2 = (Gn + G\ 2 (I — AIG 22 ) 1 MG 2 i) U\ (2.54) 
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Example 2.13. If G = 
tion. 



( 0 1 

\Ei 0 



the result is: j/i = ME iui, i.e., the series connec- 



If G = 



If G = 



E 1 I 
I 0 
I -I 
I - 1 



the result is: j/i = (Xi + M)u i, i.e., the parallel connection. 



Ei the result is the feedback connection. Indeed, in this case, 

(2.54) has as TF matrix E\ — E\{I + MEi)~ 1 MEi. As: 

(7 + ME^MEi + (7 + ME i) _1 = (7 + ME 1 )~ 1 (ME 1 + 7) = 7 (2.55) 

the output transfer matrix can be expressed as Ei — Ei (7 — (7 + MEi) -1 ) = Xi(7 + 
MEi)- 1 . Applying the push-through rule (B.5), Equation (2.52) is obtained. 



In this way, by including in G not only the system equations but also the 
interconnection structure, many control problems of engineering significance 
can be cast as the block-diagram in Figure 2.4 (left). G is then called the 
generalised plant, one of its subsystems being the actual plant. Indeed, this 
formulation allows us to deal with open-loop, closed-loop and other set-ups 
in a unified way, including performance specifications, and also allowed a 
significant theoretical breakthrough in the 1980s (see Sections 4.5.3 and 7.4). 
This block-diagram and Equation (2.54), where the block-diagram has been 
simplified by elimination of U 2 and yi, are denoted as a lower linear fractional 
transformation (LFT), and the transfer matrix in (2.54) is usually represented 
in shorthand form as Tl(G, M). 

The diagrams at the right of the referred figure present an even more gen- 
eral form of interconnection denoted as Redheffer star product, where each 
block has two input and two output vectors. It is easy to verify the correspon- 
dence to the previous models if appropriate elements of their transfer matrices 
are chosen. For instance, for 



G = 





the serial connection, (2.47), is also obtained. And similarly, the parallel and 
feedback connections can be represented. The LFT diagram is a particular 
case of the star product, if only Mu yf 0, such as the M above. 

The Matlab® command 1ft allows us to compute transfer matrices of 
systems described in an LFT or star-product structure. In particular, the 
expression sys=lft (P,K,nu,ny) connects the first “nu” outputs of K to the 
last “nu” inputs of P, and the last “ny” outputs of P to the first “ny” inputs 
of K. The resulting system model, sys, maps the remaining inputs to the 
remaining outputs. If nu and ny are omitted, the system with lower input and 
output vector dimensions is assumed to be M in the LFT block-diagram. 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: 1ft .feedback, connect , starp, series ,parallel. 
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2.8 Discretised Models 



Discretised (sampled) signals. Although the physical variables involved 
in a process are mainly CT, in order to process them on a computer, to 
simulate the process behaviour or to design a digital controller, approximate 
DT models are required. In general, attached to a CT signal, a DT sequence 
can be defined by just taking the sampled values at some given time instants. 
For a regular sampling period, T, the elements of the sequence are y k = 
y(kT ), k = 0,1,2,... . If the unit time delay is expressed by the delay 
operator, z _1 , these sampled- data (SD) signals are represented by using the 
2-transform (Appendix A). 

These sampled-data signals, under a fast enough sampling pattern, keep 
most of the information carried by the CT signal. Shannon sampling theorem 
[95] states that the sampling frequency must be twice the frequency up to 
which significant content is present in the CT signal. 

DT process models. Similarly, a DT model of the CT process (or a sampled- 
data model) can be derived. It will approximate the process behaviour relating 
the involved variables. However, some warnings should be needed in this case: 

• the attached DT model is an approximation of the CT process behaviour. 
Depending on the approximation criteria, the following situations may 
appear: 

the CT model and the SD model have a similar time-response to a 
given input signal (impulse, step, ramp, ... ), 

the CT model and the SD model have a similar frequency-response in 
a range of frequencies, 

the CT model and the SD model have a similar mathematical ap- 
pearance (by substituting the time derivative by increments ratio, for 
instance). 

• the intersampling behaviour may be rather different. Caution should be 
taken about the information lost from the input signal, 

• the DT model parameters will change if the sampling period is changed. 

The most usual and common discretisation is based on the use of a digital 
computer, leading to regular sampling characterised by a period T, together 
with a constant holding of the input during the same period. To get an SD- 
equivalent model of the process, the simplest discretisation approaches are 
based on the approximation of the derivative operator. There are many options 
to implement this approximation: 






Euler. For each derivative term, the following approximation is imple- 
mented: 



Ax _ x k +i - x k 
~At ~ T 



(2.56) 



provided T is small enough. This approach can be also applied to non- 
linear systems. The equation (2.10) is transformed into: 
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dx(t) 

dt 



u(t),t) —> Xk+i = X k + Tf(x k ,u k , k) 



(2.57) 



The DT model will relate the DT signals. For this purpose, dealing with 
linear systems, the sequences are represented by their ^-transform. To get 
the Euler-discretisation of a CT transfer matrix, the Laplace variable, s, 
is replaced by: 

1 - 0" 1 
S “ T 

• forward operator. In a similar way, a CT transfer matrix can be ap- 
proximated by replacing the Laplace variable, s, by: 

z-1 
S ~ T 

• bilinear transformation. Among the possible variations of the previous 
approximations, if the Laplace variable is replaced by: 



21-r 1 
Tl + z- 1 



(2.58) 



the transformed DT model will be stable if and only if the source CT model 
is so, which is indeed of interest. This is a useful discretisation approach, 
although it is only valid for linear systems 5 . 

In the next chapter, for LTI systems and based on the solution of the state 
equation, exact (step response) SD models will be also derived. Non-regular 
sampling may be considered, leading to more complex DT representations 
(Section 9.4). 



2.9 Equivalence of Representations 

All the representations of the same process should be coherent. If they re- 
late to the same variables, they should be equivalent. Thus, given the state 
space model or the polynomial operator, the transfer matrix should be eas- 
ily obtained. In fact, by applying the Laplace transform to Equations (2.17) 
and (2.19), assuming that the initial condition terms are null, the following 
equivalence is obtained: 



sx(s) = Ax(s) + Bu(s) 
y(s ) = Cx(s) + Du(s) 

5 For computer simulation of non-linear systems, an approximate equivalent is the 
mid-point discretisation formula: 



Xk-\-i — x k T T f {x k T T/2 f (x k , v>k ) , 



T ^fc+1 



2 
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y(s) = [C{sl - A)~ 1 B + D]u(s) = G(s)u(s) 



Thus: 

G(s) = [C(sl- A)~ l B + D] 
Based on this equivalence, as 

(cI A )-i _ adj(sI-A) 

[ ’ det (si - A) 



(2.59) 



the poles of G(s) are the eigenvalues of A (solution of the characteristic equa- 
tion det(sJ — A) = 0). 

An interesting representation for ( si — A)^ 1 can be derived if this matrix 
is expanded in series I + As + As 2 + . . . : 



G(s) = D + CBs~ l + CABs ~ 2 + CA 2 Bs~ 3 + ... = £) H t s~ i (2.60) 

2=0 

Also, for DT systems: 



G(z) = D+C(zI—A)~ 1 B = D+CBz- 1 +CABz~ 2 + .. . = ^ H (2.61) 

i=0 

Hi are denoted as Haenkel parameters or coefficients. In this DT representa- 
tion, Hi is the impulse response at time i, because y(z) = G(z) if u(z) = 1. 

The reverse transformation is not so easy. First, the state representa- 
tion is not unique, thus there will be many internal representations for the 
same input/output model. Second, some of these representations may be over- 
dimensioned and so useless, spurious, internal variables will be included. One 
option would be to use the concept of memory or accumulation attached to 
the state variables and try to define them in this way. Another alternative is 
to attach a state variable to each process pole. 

To properly deal with this issue, some knowledge about the process struc- 
ture and properties should be available. This is the subject of the next chapter 
(Section 3.7.5), and thus the reverse transformation is postponed, with only 
a very simple example being presented now. 

Example 2.1^- Let us consider the 2x2 transfer matrix of Example 2.10. Based on 
the partial fraction decomposition, let us assign the state variable, X\, to the pole at 
the origin and the variables xi and xz to those related to the pole at — 1. A possible 
state space representation would be: 

X\ = —Ml + U2\ X2 = —X2 + Mi; X3 = —*3 — M2 

yi=xi + x 2 ; y2 = xi+x 3 



A = 



0 


0 


0 \ 




- 1 


1 


0 


-1 


0 


; b = 


1 


0 


0 


0 


-1/ 




V 0 


1 



C = 



1 1 0 \ 
1 0 1) 



That is: 
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Also, the transfer matrix may be extended to become: 




From (2.35), the relationship between the transfer matrix and the polyno- 
mial representations is clear: 



G(s) = D~ 1 (s)N(s) 



Again, the reverse is not unique and many options are possible. 



2.10 Disturbance Models 

Disturbances are non-manipulated inputs to the process. They are generated 
elsewhere but affect the process behaviour and are signals coming from an- 
other processes. 



2.10.1 Deterministic Signals 



If the structure of these processes, denoted as generators, is known, the distur- 
bances are said to be deterministic. For instance, polynomial disturbances can 
be considered as being generated by a chain of integrators. The initial condi- 
tion of each integrator will determine one of the parameters of the polynomial 
signal. For instance: 

• constant signals, y = a\, are generated by: 

*i = 0; aji(0)=ai; y(t) = xi(t) 

• ramp signals, such as y(t) = ai + a%t, by: 

xi=x 2 \ *2 = 0; *i(0) = ai; *2(0) = a 2 ; y{t) = xi(t) 



and, in general, polynomial signals, such as 



are generated by: 



y(t ) 



E 



a i A - 1 

(i-1)! 



±1 = *2; *2 = *3; • • • ; Xn = 0 



y = x 1 



where a,; = *j(0), and n! denotes the factorial of n. 
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Discrete disturbances. If the generators are built up with accumulators 
instead of integrators, DT signals can be generated. For instance, with: 

xi(k + 1) = xi(k) + x 2 (k)\ x 2 (k + 1) = x 2 (k) + x 3 (k); 

x n (k+ 1) = x n (k); y(k) = xi(k) 

the output is given by: 

y{k) = xi(0) + kx 2 (0) + ^ x 3 (0) + ^ ^ k _ ^ ^(0) 

Similar expressions can be obtained for exponential or sinusoidal signals. 

The most common deterministic signals are summarised in Table 2.2. Dis- 
turbance randomness can be inserted if random impulse inputs, ip, are as- 
sumed at time t. 



Table 2.2. Generation of deterministic disturbances 





CT 


DT 


Steps 


d(t) d = A 


7 def . 

dk = A 




d = ip 


dk -\- 1 = dk 'Ipk 


Ramps 


d A = at + b 


dk *= f ak + b 






Xk + 1 = ( 0 1 ) Xk + ipk 




d = [1 0]* 


H 

O 

\ 

' II 


Sinusoidal 


d Tsin(wf + B) 


dpf 

dk = Asin(u>Tk + B) 




i,= (-° a o) a! + ^ 


( cos uT sin ujT \ 

Xk + 1 = • rr, rr, ) Xk+1pk 

V — sin u>T cos loT / 




J1 

II 


H 

O 

II 



Example 2.15. It is easy to show that, with the system defined by: 

x = a.x; a;(0) = xo; y — x 
the signal y(t) = xoe at is generated. Similarly, by: 

Xi = x 2 \ x 2 = w 2 x i; a:i(0) = j4sin(i^); *2(0) = ,4cos(<p) 

y = x 1 

the signal y(t) = ,4sin(wt + ip) is generated. 

2.10.2 Randomness in the Signals 

It frequently happens that the model of the process generating the external 
signals is very complex or unknown. In this case, it is easier to characterise 
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the signals by their stochastic properties. They can also be considered as 
the output of stochastic generators or as the filtered response of an original 
stochastic signal. These disturbances may appear at the output (as measure- 
ment noise), at the input or at the state level. Let us briefly describe these 
types of variables: 

• measurement noise. The output of the sensor system is affected by a 
number of random variables from which no information is available, such 
as device drifts or interference from other devices. The main goal would be 
to filter, reduce or cancel the noise, getting a clean measurement to feed 
the monitoring or control system, 

• stochastic inputs. They affect the process behaviour as external variables 
and they are unavoidable. If we consider the positioning of an antenna, 
the force of the wind will present such a characteristic, 

• internal noise. These are the most complicated disturbances and, in some 
cases, they can be modelled by assuming stochastic parameters in the 
process models. A way of dealing with this situation is by considering 
uncertainties in the model or in the variables. An introduction to the 
available tools is presented in Chapter 8. 

In a general sense, the control goals under stochastic disturbances will be: to 
filter the measurement noise or output disturbances, to attenuate or cancel 
the input disturbances, probably by measuring them if it is possible, and to 
assure some performances under process noise, due to uncertainties in models 
or disturbances. 

In order to characterise the stochastic signals, some basic statistic concepts 
and measurements about random variables should be remembered. Some of 
them are random variables, distribution and density functions, mean, variance, 
covariance, correlation, statistical independence and linear regression, among 
others. A short review of these concepts is included in Appendix E, where 
special attention is paid to the multivariable case. 

2.10.3 Discrete Stochastic Processes 

A signal, of which the value at any time instant is a random variable, is called 
a stochastic process. A discrete stochastic process is a sequence of random 
variables and can also be obtained as a result of sampling a CT stochastic 
process. 

In the following, only discrete stochastic processes are considered. Their 
main properties are related to those of the random variables in the sequence, as 
well as their interaction. Let us review the most common (simplified) models 
of stochastic processes. 

White noise. White noise (WN) is the simplest stochastic process, {ffc}. 
The discrete random variables in the sequence are zero-mean {E{ek) = 0), 
and independent of each other. If their variance is E(e'j,) = the covariance 
between samples j and k is: 
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a jk ~ 




j = k 
j 



(2.62) 



Due to the independence among variables, the knowledge of the current or 
past values in a sequence is useless for determining the future values. In this 
sense, WN cannot be compensated for or predicted. 

If there is some kind of relationship among the variables, that is, if the 
random variables in the sequence are not independent, some additional infor- 
mation is available and the “noise” treatment may be easier. The rest of the 
stochastic processes are denoted as coloured noise. Some of them are easily 
modelled. 

Random walk (drift). This can be considered as an accumulated white 
noise: 

Vk+ i = v k + £k\ £fc is WN (2.63) 

Thus, the difference between two consecutive variables is WN. Their covari- 
ance can be expressed by: 

0 *(fc+i) = E(v k v k+ i) = E(v k (v k + £k)) = E{vl) + E(v k e k ) = o\ 

Coloured noise (general model). A general model of coloured noise can 
be represented as the output of a dynamic (DT) process: 



Xk+l Ax k T £ k 

v k = Cx k 



where £ k is a WN. Thus, based on the past and current values of the {u(&;)} 
sequence, some information about the future values can be estimated. 

Similarly, if the noise is disturbing a DT process which has, in addition, 
manipulated inputs, the equations equivalent to (2.21) and (2.22) would be: 

x k+1 = Ax k + Bu k + B d v k , 2 , 

Vk = Cx k + Du k + D d w k ^ 

where v k and w k are white noises with covariance matrices V and W respec- 
tively. Usually, D = 0 and D d = I, w k being the measurement noise and v k 
the process noise. 



Input/output models 

Other than the internal representation above, a monovariable stochastic pro- 
cess may be represented by a difference equation or, alternatively, using the 
general concept of the Z-transform of a sequence, it can be also expressed by 
an input /output model such as: 

v(z) = G n (z)e(z) e k is WN (2.66) 

It is worth mentioning some typical representations that are rather com- 
mon in literature [30, 84]: 
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• Moving- Average (MA). The signal is obtained as a weighted sum of current 
and past inputs: 

n 

y(k) = ^ ~2bis(k - i) 

i = 0 

• Auto-Regressive (AR). The weighted sum of the signal is a random noise: 

n 

y{k) + ^2 aiy ^ k ~ *) = £ ( fc ) 

i= 1 

• Auto-Regressive-Moving- Average (ARMA). This is a combination of the 
two above, 

n n 

y(k) + ai y( k - *) = bi£ ( k ~ *) 

2=1 2=0 

• External-Auto-Regressive-Moving- Average (ARMAX). In this case, there 
is also a manipulated input, u(k), leading to: 

n n n 

y(k ) + ^ a.iy(k -j) = y^ biu(k - i) + ^ Ci£{k - i) (2.67) 

2=1 2 = 0 2=0 

However, the state space representation will be pursued in this book for 
disturbance rejection control designs, as all the above models can be expressed 
in a form similar to (2.64) or (2.65). 



2.11 Key Issues in Modelling 

As has been emphasised in this chapter, the model of a process is a partial 
representation of its behaviour. In this sense, the model we are interested in 
is a model suitable for designing the control system. Thus, the selection of the 
model and the modelling approach depends on the final goal: 

• the details of the model are determined by the control goals. Static, low- 
frequency range, autonomous, DT or hybrid models are examples of op- 
tions, 

• the variables and relationships selected to build the model will depend on 
the effects we are interested in in our study. Some variables can be deleted 
or treated as disturbances if they are not so relevant, or they can become 
crucial if their particular effect has to be modelled, 

• the control design methodology will recommend, or even determine, the 
type of representation, 

• the knowledge and/or availability of the process to get actual data will 
allow for theoretical or experimental modelling techniques, 

• the accuracy and complexity of the model will depend on the control re- 
quirements. 
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How do we obtain a model? As a summary, two main approaches can be 
followed: 

• first-principle (internal) model. Leading to (detailed) non-linear mod- 
els, with physical insight into the variables and equations, and a number 
of parameters to be determined. Techniques of model reduction may need 
to be applied, 

• experimental modelling (Appendix A. 4). By comparing the behaviour 
of the plant to that of some predefined models and structures, the models’ 
parameters can be estimated, leading to (simple) approximate linearised 
models, being usually input/output representations. This approach is suit- 
able for modelling disturbances if historical records of them are available. 

According to the model purpose and the analysis of its properties, a change 
in the representation frame, its complexity, its range of validity or the number 
of involved variables may be suggested. Thus, the modelling phase should be 
revisited in the control design process, to enhance the available model to better 
fulfill the control requirements, the final goal in our study. 



2.12 Case Study: The Paper Machine Headbox 

The purpose of the headbox is to deliver a uniform and stable jet velocity 
profile in both cross and machine directions to form the paper sheet, Figure 
2.5. The stock flows into the headbox chamber controlled by a valve. The top 




Figure 2.5. Headbox simple schema 



of this chamber is filled with compressed air to dampen pressure pulsations. 
The airflow is also controlled by an input valve. The stock is homogenised in 
this chamber and it flows through the slice channel to the wire. 



2.12.1 Simplified Models 



First-principle. A very simple first-principle model can be derived by mass 
balances. 

Stock balance in the headbox: 



m 



dh(t) 



dt 



q{t) - S(t)v(t) 
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where h is the stock level, in m, A is the headbox section, in m 2 , q is the stock 
inflow, in kg/s, S is the slice lip section, in m 2 , and v is the stock exit speed, 
in m/s. 

The stock exit speed due to the total “head pressure” H, in m, is: v(t) = 
\/2 gH(t); H (t) = h(t ) + p(t) 

The air compression is assumed to be isothermal, thus p(t)V a {t) = const , 
where p is the air pressure, in equivalent stock height (m) and V a is the volume 
of air in m 3 . 

Air pressure variations are due to air net inlet flow and volume reduction, 
thus: 

= a (p„(«) -*))-«§ 

where A is the chamber dynamics inverse time constant, in s -1 , P a is the 
source air pressure, in equivalent stock height, in m, and n is a compression 
adimensional constant. 

The slice lip exit area is manipulated by an external motor. In this sim- 
plified model, it is assumed constant or slowly-varying. 

In this simple model, the head and pressure can be chosen as state vari- 
ables, whereas the manipulated variables could be the stock inlet flow and the 
source pressure, leading to the state model: 

h = ~^yj2g{h + p) + 

g 1 

P = K— \/2 g{h + p) - A p- K—q + A P a 

Experimental. By applying steps at the inputs at an operating point, the 
elements of an approximate transfer matrix may be estimated. Additional 
transportation flow delays between the stock valve and the headbox chamber 
input may be realised. This can be done on the real plant or on a simulated 
model. This could result in a transfer matrix model obtained as in Example 
2.9: 

r r e~ s -1 1 r 

h _ 1 + s 1 + U.5s q 

ii p $ n 9 — i— q P 

[ (1 + s) (1 + 2s) (1 + 0.5s) (l + 2a) J 



Discrete model 



From the first-principle non-linear state space representation, a simple DT 
model may be obtained by the Euler approximation of the two state variable 
derivatives. 

Alternatively, from the experimental model above, the following discreti- 
sation approximations can be obtained: 
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1) Discrete transfer matrix. To get a discrete model, it could be easy 
to discretise each element of the transfer matrix, assuming a zero-order hold 
(ZOH) device in the input and a regular sampling period, T, at the output. If 
this period is assumed to be T = 0.5 s, the time delay of 1 s, will be equivalent 
to two delay units, z _1 . That is, Z[e~ s ] = 2 -2 . 

Taking care of the delays, the Matlab® command Gd=c2d (G , . 5 , 1 zoh ; ) 
returns the DT transfer matrix: 



G(z) 



0.3935 -0.6321 

z 2 (z- 0.6065) 2 - 0.3679 

0.04892 + 11.0381 0.29082 - 0.2628 

. 2 2 (2 - 0.6065)(2 - 0.7788) (2 - 0.3679)(2 - 0.7788) . 



(2.68) 



2) State representation based on physical variables. From this DT 
transfer matrix, grouping the common poles by rows or columns, the block- 
diagram in Figure 2.6 can be drawn. 




Fdt3 



Figure 2.6. DT Block-diagram of the headbox (where F = q) 



Then, a state variable can be directly assigned to each first-order block 
(Fdt2 and Fdt3 share the same one), leading to the internal representation: 

* 1 ( 2 ) = \q{z) — > xi(k + 1) = q(k) 

* 2 ( 2 ) = -xi(z) — * X 2 (k + 1) = xi(k) 

z 

X 3 ( 2 ) = - _ X3 ( k + 1 ) = * 2 ( fe ) + 0. 6065*3(10 ) 

*4 (z) = 1 Pa ( 2 ) -> X 4 (k + 1) = 0.3679* 4 (lo) + P a (k) 

z — 0.3679 



(* 



_ 0.04892 + 0.0381 , 0.29082 - 0.2628 

X5l z ) - ^ _ 0.7788 X3 ^ z> z - 0 7788 X4 G 



z - 0.7788 



0.7788) * 5 ( 2 ) = (0.04892 + 0.0381) x 3 ( 2 ) + ( 0.29082 - 0.2628) x 4 ( 2 ) 
x 5 (k + 1) = 0.7788*5 (k) + 0.0489* 3 (k + 1) + 0.0381* 3 (fc) 
+0.2908* 4 (A: + 1) - 0.2628* 4 (fc) 
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and rearranging the last equation: 

x 6 (k + 1) = 0.7788*5 (A: ) + 0.0489 [x 2 (k) + 0.6065* 3 (fc)] + 0.0381* 3 (fc) 

+0.2908 [0.3679* 4 (fc) + P a (k)] - 0.2628 * 4 (fc) 
x 5 (k + 1) = 0.7788*5 (fc) + 0.0489* 2 (fc) + 0.0678* 3 (fc) - 0.1559* 4 (fc) + 0.2908P a (fc) 

The output equation would be: 



h{k) = 0.3935* 3 (fc) - 0.6321* 4 (fc) 
v(k) = *5 (k) 



Altogether, the state representation is: 



j x{k + 1) = Afx(k) + Bfu(k) 
\ y(k ) = Cfx(k) + Dfu(k) 



A t = 



'0 


0 


0 


0 


0 




A 


0 


1 


0 


0 


0 


0 




0 


0 


0 


1 


0.6065 


0 


0 


; B f = 


0 


0 


0 


0 


0 


0.3679 


0 




0 


1 


0 


0.0489 0.0678 


-0.1559 0.7788 J 




|_0 0.2908 J 



C f 



0 0 0.3935 -0.6321 0 
0 0 0 0 1 



Df 



0 0 
0 0 



(2.69) 



2.12.2 Elaborated Models 

An in-depth model has been developed at the Pulp and Paper Centre (Univer- 
sity of British Columbia, Vancouver, Canada), reported in [127]. To express 
the dynamics of the upper chamber, the interconnected liquid and gas-flow 
systems are considered. A mass-balance equation for the stock and the stock 
flow out of the lreadbox can be obtained by applying: 



d ^ = q^C s S s /2^h]-2S 0 j2 ^ P Po) A (2.70) 

at v y Pw 

where hj is the head at the slice lip, in m, C s is the valve-sizing coefficient, S 0 
is the area of overflow valve opening, in m 2 , po is the atmospheric pressure, 
in m, and p w is the density of stock, in Kg/m 3 . 

A mass-balance equation for the air using the pressure density relationship 
gives the following equation in terms of pressure: 



dp 


- | 


( E} 


(k~i) 

\ k 


qi-q e t Po A (^) k w1 


dt 


Po 


\Poj 


1 


1 

- 

1 



(2.71) 
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where po is the air density, in kg/m 3 , n is the specific heat ratio, qt and q e 
are the air inflow into the upper chamber and outflow through the bleed valve, 
in kg/s. 

To write the equation which governs the rate of change of the head at the 
slice lip, hj , the headbox inlet head, hi, and the friction head loss, hf, are 
considered. The following equation is obtained: 



dhj 

dt 



\j2ghj 

L 



[H-hj 



h f) 



(2.72) 



where L is the constant of the slice channel, in meters, and hf is the friction 
head loss. 

The stock level, h, in the headbox, the airpad pressure, p , and the head at 
the slice lip, hj, are chosen as the state variables. 

The stock inflow, q, the gas flow, q e , defining the net air inflow and the 
slice lip area, S, are treated as inputs. 

The headbox dynamics can thus be represented by a third-order non-linear 
dynamical system. The model is characterised by a number of construction- 
dependent parameters (A,V a , S 0 , hf and Cds ) as well as some fundamental 
physical parameters ( k,po , po, p w and g). The values of q, qi — q e or S 3 depend 
upon the operating point. Knowing the design details of the headbox and the 
operating point, all these variables could be calculated quite easily. 

The three equations are highly coupled. Equation (2.70) shows that if the 
input stock flowrate increases, the liquid level increases. This in turn increases 
the airpad pressure and the total head. This increases the outgoing stock flow. 
There is thus a self-regulating effect in the system. 

Equation (2.71) shows that the airpad pressure will return to its original 
value when the equilibrium point is reached. Any deviation in the level will 
thus be contributing to the total head. 

Changing the air output area changes the air outflow, affecting both the 
level and the pressure inside the airpad. An increase in the slice opening will 
produce a decrease in the level, airpad pressure and the total head. 

The most important control problem for a headbox is to maintain constant 
jet velocity and to have a good dynamic behaviour when changing the grades. 
We must consider as disturbances the external pressure of air and flow inlet, 
as well as the consistency of the stock or physical characteristics of the flow 
resistance. 

In spite of the model complexity due to non-linearities, the model order is 
reduced to 3, which is even lower than the experimental one obtained in the 
last chapter. 

Linearisation. The previous non-linear model is useful for simulating and 
studying the dynamic behaviour of the headbox. To design control strate- 
gies, it is always convenient to have linearised models which approximate the 
non-linear dynamics for small disturbances around a steady-state point. In 
[127], the following linearised model is obtained for some given parameters 
and operating conditions, using the Matlab® command linmod. 
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0 


-0.00083 


-0.03 1 




'10 0' 


A = 


0 


-0.08849 


-1.041610 


; C = 


0 1 0 




9.1371 


9.1371 


-8.883063 




0 0 1 





" 0.47597 0 -0.048587' 




'0 0 0" 


B = 


14.03999 -0.00162 -1.433194 


; D = 


0 0 0 




0 0 -57.9134 




0 0 0 



The eigenvalues of the system matrix A are (—0.0005, —10.3254, —0.9950). 
Thus, the system has a very slow mode with a time constant of about 512 s 
and two fast modes with time constants of less than a second. 
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Linear Systems Analysis 



This chapter covers the study of the dynamic behaviour of linear models. Dif- 
ferential equations and operations with the Laplace transform and its inverse 
are assumed to be the subject of introductory courses ([78, 49, 94] and basic 
outline in Appendix A). State space approach will be presented in some detail, 
with emphasis placed on obtaining reduced order models that are suitable for 
control purpose design. Important concepts in theory and practice (such as 
gain, poles, ... ) will be presented as well, paying attention to the issues that 
are mainly related to multivariable systems, such as the system structure and 
the interactions. 



3.1 Introduction 

Most of the concepts and ideas developed in this book are based on process 
models. If the model is accurate enough, the analysis of its properties will 
provide an estimation of those from the actual process. If analysis is carried 
out previous to the controller design, it is denoted as open-loop analysis. The 
study of specific properties of a plant-controller combination is denoted as 
closed-loop analysis. 

By this analysis a number of characteristics should be determined: 

• stability. It is the basic feature of any controlled system. Related to this 
concept are issues such as degree of stability and, in a general way, the 
characterisation of the dynamic behaviour, 

• accuracy. The system gains in steady-state, instantaneously, aucl as a 
function of the frequency. One major issue in MIMO systems is the concept 
of directionality : the gains depend on the input direction, that is, in the 
combination of inputs under study, 

• structure. Interactions/independence among sets of variables, subsystem 
division, 

• robustness. Availability for maintaining the above properties under 
changes or uncertainties in model parameters or disturbances. 
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All these properties are also present in the analysis of SISO systems, but the 
richness and complexity are by far larger in MIMO systems. In fact, provided 
that there is more than one manipulated variable, issues such as the selection 
of inputs and their purpose, or the study of interactions, cancellations or 
complementary effects, will condition the success of a control system. 

Most of the concepts will be presented using the state space representation, 
introducing their interpretability and use with other representations. 



3.2 Linear System Time-response 

Continuous-time systems. Given a CT linear system, as defined in (2.17) 
(2.19): 

x(t) = Ax(t) + Bu(t ); y(t) = Cx(t ) + Du(t) (3-1) 

with initial conditions, x(t o) = Xo, the state and the output may be computed 
at any time, t > 0, by solving this differential equation. The solution of a scalar 
first-order differential equation, x(t) = ax(t) + bu(t), is given by: 

x(t) = e a{t ~ to) x(t 0 ) + f e a(t ~ T) bu(T)dT 
Jto 

where the first term is the solution of the homogeneous equation, x(t) = ax(t), 
and the second one corresponds to a particular solution for the input u(t). In 
the same way, for the first-order differential state vector equation in (3.1), it 
is (see Appendix B.5): 

x(t) = e A ^- to) x(t 0 ) + f e A{t ~ T) Bu{T)dT ; (3.2) 

Jto 

y(t) = Ce Mt ~ to) x(t 0 ) + C [ e A ^~ T) Bu(T)dT + Du(t) (3.3) 

Jto 

Autonomous (free)-response. If the initial state is a;(0j = x$ and the 
input is null, u(t) = 0; Vt, the state and output response is: 

x(t) = e At x 0 = <j)(t)x 0 ; y(t) = C(j){t) x 0 (3.4) 

where cf>(t) = e At is the transition matrix. Observe that by applying the 
Laplace transform to the state equation, with null input, it yields: 

sa:(s) — Xq = Ax(s) — > a:(s) = (si — A)~ 1 x o 

The Laplace transform of the transition matrix, (j>(t), is denoted as the resol- 
vent matrix, <fr(s) = (si — A) -1 . 
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Forced response. If the initial condition term vanishes (the system is at an 
equilibrium point), the forced response due to a specific input is obtained: 

x(t) = f Bu(t) d,T\ (3.5) 

Jt o 

y(t) = C f e A( ' t ~ T ' 1 Bu(t) dr + Du(t) (3.6) 

Jt o 

Impulse response. Being at equilibrium, if input u, is a unitary impulse, 
S(t), the response is: 

y(t) = Ce At bi + D8(t) 

where 6,; denotes the zth column of B. If D = 0, 

G(t) = Ce At B = 

is denoted as the impulse-response matrix. The forced output may be ex- 
pressed by a generalisation of the convolution formula (A. 15): 

y(t) = G(t) * u(t) = f G(t — t)u(t)cIt) 

Jt 0 

For details on the above issues, the reader is referred to [11]. 
Discrete-time systems. For DT systems 



x k +i = Ax k + Buk 
y k = Cx k + Du k 

the solution of the state equation yields: 



(3.7) 

(3.8) 



xi = Ax o + Buq 
X2 = Axi T Bui — A 2 x 0 ABu 0 T Bu\ 
X3 = A 3 xq + A 2 Buq + ABu\ + Bui 



k - 1 

x k = A k x o + A k ~ :i ~ 1 Buj 

3=0 

y k = Cx k + Du k 



(3.9) 

(3.10) 



From the above expression, the output can be also expressed by a discrete 
convolution: 



yk 



j=k - 1 



3=0 



j=k 

^ Z H (k-j)uj 

3=0 


(3.11) 


Buj + Duk 


(3.12) 
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where the Haenkel parameters are as defined in Equation (2.61): 

H(j) = C A 1 B j > 1 

H{ 0) = D 



(3.13) 

(3.14) 



3.3 Stability Conditions 

A general definition of stability should be applicable to any dynamic system 
and it would appear as: a system is stable if it presents bounded outputs for 
bounded inputs. Stability as such, in a general non-linear case, may be cum- 
bersome to assess. In general, the stability of a (non-linear) process is studied 
around an equilibrium point or a nominal trajectory and, in this case, the pro- 
cess behaviour can be most of the time approximated by a linear model. This 
is called local stability , applying the term of global stability if this property is 
analysed for any input or initial condition of the process. In-depth analysis 
can be consulted in [74]. 

In the case of linear systems, stability is a more concrete property that 
can be unequivocally characterised. 

Continuous-time. Matrix exponentials determine the time-response of CT 
systems. The reader is referred to Appendix B.5 for details. Particularly, if the 
state representation is in diagonalised canonical form {A = A = diag{Xi(A)}), 
the transition matrix will also be diagonal: 

e At = diag{e Xi(A)t } (3.15) 

and (3.2), as well as the system output, will be composed of a sum of these 
diagonal terms, denoted as modes. Thus, the system acts as a generator of 
signals represented by the modes. 

As argued in (B.6), page 288, the exponential terms arising in the solution 
of (3.1) are the eigenvalues of A. For each exponential, the usual analysis in 
Section A. 2.1 can be carried out regarding stability and approximate settling 
time. 

As a conclusion, the stability condition for a CT linear system, such as 
(3.1), is: 

l?e{A,(A)} < 0, Vi (3.16) 

where Re{} stands for the real part. 

A CT linear system is stable if there are not eigenvalues of the system 
matrix A (poles of the transfer matrix) in the right-half-plane (RHP) 
of the complex plant. 
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Discrete-Time. With a similar reasoning, the stability condition for a DT 
linear system is: 

|Aj(A)| < 1, Vi (3.17) 

A DT linear system is stable if there are not eigenvalues of the system 
matrix A (poles of the transfer matrix) outside the unit circle in the 
complex plane. 



3.3.1 Relative Degree of Stability 

The stability condition, (3.16), allows the comparison of the relative degree 
of stability among CT systems. If 

Re{Xi(A)} < -a < 0, Vi (3.18) 

then any state has a trajectory bounded by |xj(t)| < Me~ at for some constant 
M or, equivalently 

lim e+^e^-^xito) = 0 

t— >oo 

This provides a measure for estimating the settling time. Nevertheless, for the 
output signal, matrix C may hide some modes (see Section 3.7). 

A similar relative degree of stability can be defined for DT systems. 



3.4 Discretisation 

Although CT models better approximate the behaviour of actual systems, 
their control is usually implemented in a digital system, so the overall system 
is hybrid. To simplify its treatment, there are two common approaches: 

1. Designing a CT controller, and trying to find an “equivalent” DT con- 
troller 

2. Assuming a DT “equivalent” model of the process, and designing a DT 
controller. 

This equivalence can be established using different criteria: 

• matching the response to an equivalent input (step, impulse, ramp, ... ), 

• keeping a similar structure: substituting the derivative by a DT approx- 
imation (Euler, bilinear, ... ), as seen in Section 2.8. This is the natural 
approach to discretise polynomial representations, 

• preserving some properties, like stability (matching of poles and zeros). 

In a control environment, the output is usually sampled periodically and, 
with the same frequency, the input is updated through a hold device (see 
Chapter 9 for implementation issues). 
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In a first approach, discretisation strategy will be based on the following 
assumptions 1 : 

• assume synchronous and instantaneous sampling/updating processes, at a 
regular sampling period, T, 

• replace any CT signal, y(t), by its sequence, y{kT). Usually, the Z- 
transform of this DT signal, y(z), is handled, 

• assume the process inputs, u(t), to be constant between sampling times 
(ZOH device). That is, u(t) = u(kT);\/t kT < t < (k + 1 )T. Thus, the 
input is a sequence of steps. 

Following this strategy for a SISO with transfer function, g(s ), the DT 
equivalent transfer function is obtained [21] by computing: 

g(z) = (l-z- 1 )Z T (C-\^)) (3.19) 

Thus, the samples every T seconds of the step response of the CT system will 
match that of the DT system. 

Discretisation of transfer matrices. Each element of the matrix can be 
discretised following the above approach. The result will be a DT transfer 
matrix, G(z), matching the input step-response of the CT system. For each 
element gij(s) of the matrix, (3.19) is applied, obtaining the corresponding 
9ij{ z )- 

The Matlab® command c2d, with arguments the CT transfer matrix, the 
sampling period and the discretisation method, gives as a result a DT transfer 
matrix. 

Example 3.1. The DT model of the CSTR, Example 2.1, can be easily obtained, 
using: 

GD=c2d(Gp , . 01 , ’ zoh’ ) ;zpk(GD) 

TF from input 1 to output . . . from input 2 to output . . . 

0.029249 (z-0. 1489) (z-0. 5626) 0.00020763 (z+2 . 16) (z+0 . 1357) 

#1: # 1: 

(z-0. 1479) (z-0. 5807) (z-0. 9819) (z-0. 1479) (z-0 . 5807) (z-0 . 9819) 

-0.23504 (z-0. 1044) (z-1. 007) -0.20653 (z+0. 4445) (z-0. 9831) 

#2: #2: 

(z-0 . 1479) (z-0 . 5807) (z-0 . 9819) (z-0 . 1479) (z-0 . 5807) (z-0 . 9819) 

0.13503 (z+0. 4411) (z-1. 007) -1.5969 (z-0. 745) (z-0. 981) 

#3: #3: 

(z-0 . 1479) (z-0 . 5807) (z-0 . 9819) (z-0 . 1479) (z-0 . 5807) (z-0 . 9819) 

1 The use of other sampling strategies, hold devices or the analysis of the inter- 
sampling behaviour of the CT signals is beyond the primary goal of this book. 
In [1, 2], a detailed exposition of these topics is presented. Section 9.4 outlines 
control under dual-rate sampling. 




3.4 Discretisation 



59 



where a T = 0.01 s sampling period is selected and a step-response-equivalent DT 
model is defined by ’zoh’. Note the different pole position if a different sampling 
period (for instance T = 0.1s) is selected. 



Discretisation of State Space Representations 



Applying (3.2) to a sampling period, the hold device behaviour involves keep- 
ing constant the input in the inter-sampling interval: 

r(k+l )T 

x((k+l)T) = e AT x{kT) + / e A ^ k+l)T) ~ r) dTBu{kT) (3.20) 

JkT 

that is: 

Xk -\- 1 — “I - Buk (3.21) 

where it is clear that these matrices can be obtained by: 

A=e AT ; B = [ e Ar drB (3.22) 

Jo 

An alternative approach can be followed to compute these matrices, avoid- 
ing the integral involved in B. 

Consider an augmented “state” vector, including the equation u = 0: 

216 = (o o) (w) = Ae:Ce ( 3 ‘ 23 ) 




the intersample response can be interpreted as a “free response” of the aug- 
mented system. By (3.4), for kT < t < ( k + 1 )T: 

Xe(t) = = e A ^ Xe{kT) (3.24) 

so, partitioning the matrix exponential, the matrices in (3.22) are: 



Jab 

1 ° 1 



„A.T 



(3.25) 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: expm, c2d, c2dm, d2c. 



Example 3.2. The Matlab® code for discretising a system is (Abar=A, Bbar=B): 

s = expm([[a b] *t ; zeros (nb,n+nent)] ) ; 

Abar = s(l:n,l:n); Bbar = s (1 :n,n+l :n+nent) ; 
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3.5 Gain 

The concept of gain is very useful for characterising the behaviour of a system, 
usually assuming stable behaviour. It refers to the relation between the output 
and input “magnitude” . But it can be defined as relating to the time behaviour 
(static, instantaneous), the frequency of the input and, in the case of MIMO 
systems, the direction of the input (the input vector components). 

Scaling. It is clear that in order to compare magnitudes the measurement 
units are critical. Thus, to determine the gain or ratio between the magnitude 
of variables, even more so in a MIMO system, their measurement should be 
normalised so that they are comparable. The recommended scaling is: 

• scale-manipulated variables so that the actuator range is mapped to 

[— M], 

• scale disturbances so that its maximum estimated value is mapped to 1, 

• scale-controlled variables so that one unit in the new scaling is equivalent 
to the maximum admissible errors. 

In this way, individual units and limits for dozens of variables in a com- 
plex MIMO model can be forgotten and the gains that are discussed below 
can be compared with unity for controller validation. Scaling has no deep 
mathematical roots, but it is useful in practice. Also, it may avoid errors in 
determining how well-conditioned a problem is (see page 292). In some cases, 
measurements (may be different to controlled variables) should be scaled so 
that measurement noise is of a similar size (to help in variables’ selection, 
Section 4.3). 



3.5.1 Static Gain 

Given a stable system, assume a constant input vector, u(t) = u, the output 
reaching the value y(t) = y. The static gain (also denoted as DC gain) is G 
such that: 

V = Gu 

From (2.17) and (2.19), letting x = 0, the static gain is: 

0 = Ax + Bu; y = [—CA~ 1 B + D]u (3.26) 



which requires A to be regular. 



Other representations. Applying the final value theorem of the Laplace 
transform: 



y = lim y(t ) = lim sy(s) = lim sG(s)u(s) 

t — >-oo s — ^0 s—> 0 



(3.27) 



Thus, as u(s) = j: 



G = lim G(s) = G(0) 

s — >-0 



(3.28) 
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Again, recalling (2.59), G = —CA 1 B + D is also obtained. 

For DT systems, the static gain is: 

G = lim G(z) = G(l) = G(J - A)~ 1 B + D (3.29) 

Z—*l 

The static gain for polynomial representations is obtained by solving the 
system equation after deleting all the derivative terms. 

Matlab®: Some commands implementing algorithms related to the contents of this 
section are: degain, ddcgain. 



3.5.2 Instantaneous Gain 



In a similar way, the immediate response of a system to a step change in the 
input can be computed by applying: 



2/(0+) 


= lim y(t) = lim sy(s) = lim sG(s)u(s) 

t<— 0 s — ►oo s— »0 


(3.30) 


and: 




Goo = lim G(s) 

s — fOO 


(3.31) 


Recalling (2.59), 




Goo — D 


(3.32) 



That is, the input/output coupling matrix. For DT systems, the instantaneous 
gain is also given by D. 

The coupling matrix, D, is usually null in physical systems: there is no 
“immediate” response to an external action, also in sampled-data systems 
where a minimum delay of one sampling period is included. On the other 
hand, it is normally non-zero in the controller subsystems: for example, the 
proportional gain is an instantaneous one. 

3.5.3 Directional Gain 

To evaluate how big a gain is, some measurements about the size (norm) of a 
matrix should be used. A summary of matrix norms is included in Appendix 
C. The spectral radius of a matrix, as defined by 

p{G) = max | Aj| (3.33) 

i 

is a useful measure of the matrix size. However, the eigenvalues are only de- 
fined for square matrices. Furthermore, they refer to a “gain” where the output 
vector and input vector have the same direction. Relaxing this assumption, 
other directions with higher gain may be found. 
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Given an input vector with constant magnitude, |u(t)| = u o, the output 
magnitude depends on the input direction. It is interesting to know in which 
directions the extreme gains (maximum and minimum) are obtained. This 
could be relevant in determining how to act or what to measure in a controlled 
plant. For this purpose, we recall the singular value decomposition (SVD) of 
a matrix (Appendix B) . 

Given the matrix G G R pxm , (y = Gu ), its singular values are 

a, = yj Xi{GG T }- at > 0 (3.34) 

In the appendix, it is shown that there is an SVD of G expressed by G = 
U EV T , where A is a diagonal matrix. The number of non-zero entries in 
A is equal to the rank of G, and it is at most min(p, m). U € R pxp and 
V G R mxm are unitary matrices with orthonormal column vectors, ut and u, 
respectively, denoted by “input” ( V ) and “output” ( U ) coupling matrices. If 
complex matrices (such as those in the frequency-response) are considered, 
then G = USV H , and U and V are complex matrices; A, however, is still 
real diagonal. 

The physical meaning is as follows. Assume a unitary input, u = i>i . The 
output is y = UiUi, that is, a vector of magnitude a, and direction u, : . So, the 
action of G is a combination of scaling and rotations, and its directional gain 
is a sort of ellipsoid with extreme gains: 



max. gain: a = max cr, = tJi; min. gain: a = miner, = a s (3.35) 

i i 

If there is a big difference between the extreme gains, the matrix is said to be 
ill-conditioned. This is characterised by the condition number defined by: 

7(G) = ^ (3.36) 

2(G) 

Ill-conditioned plants will be difficult to control because the response is very 
different depending on the direction of the input (B.14), with high sensitivity 
to actuator modelling errors. 

Example 3.3. Let us assume the matrix 

/ 45 -72 -5 \ 

G = 0.3 1.5 -0.2 

\ 27 -45 9 ) 

The SVD gives (Matlab®, [U,S,V]=svd(G)): 

/ 0.8503 -0.5262 0.0047 \ / 99.819 0 0 \ 

[/=(mi « 2 « 3 )= -0.0112 -0.0270 -0.9996 ; 5= 0 10.32 0 

\ 0.5261 0.8499 -0.0289 ) \ 0 0 1.025 ) 
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/ 0.5256 -0.0717 -0.8477 \ 

V = (vi V2 v 3 ) = -0.8507 -0.0386 -0.5242 

\ 0.0049 0.9967 -0.0813 / 

For an input vector: u~v 3, the gain is g m in ~ g_ 3 and the output is in the direction 
of y « m 3 : 



y = G * [-0.85 - 0.52 0] T = [-0.81 - 1.03 0.45] T ; | y \= 1.39 

If the sign of the second input is changed, the output dramatically changes: 

y = G* [-0.85 0.52 0] T = [-75.69 0.52 - 46.35] T ; | y | = 88.7 

In this case, the maximum gain gmax ~ <24 would be for an input u s=s vi, and 
the output is in the direction of y « mi : 



y = G * [0.5 - 0.8 0] T = [80.1 - 1.05 49.5] T ; | y |« 94.2 

Diagonal dominance. From the control viewpoint, a particularly interest- 
ing condition of a gain matrix is the so-called diagonal dominance. For a 
square-gain matrix G = {g%^}, if Vi, such that ji ^ if i 7^ k and 



9ij t > 



iA?* 



1 9ij 



Qi 



'Ej&i 



9i,: 



< 1 



(3.37) 



there is a diagonal dominance in the sense that by a suitable raw and column 
sorting, the matrix gain will appear almost as a diagonal matrix, and G will be 
non-singular. The ratio Qi is denoted as the Gershgorin radius. The dominance 
can be analysed either by rows (as in the above definition) or by columns (see 
Appendix, page 288). 

Example 3-4- Given a gain matrix, y = Gu, 

/ 6 40 0 \ 

G = I 6 0.3 0 

\ 0.23 0.12 8.25 / 

there is a clear dominant effect (or coupling) between 1/1 <-> M2, ?/2 <-> Mi and y 3 <-> M3. 
The Gersghorin radii are £1 = 0.15, Q 2 = 0.05, q 3 = 0.042. Observe that the column 
Gersghorin radii do not show any dominance. 



The diagonal dominance concept may be used to analyse the possibility of 
matching (pairing) input/output variables in decentralised control (Section 
5.2.3). 



3.6 Frequency response 

Frequency-response techniques have been extensively applied in the study of 
SISO systems. We recall that the steady-state output of a linear system under 
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a sinusoidal input is also sinusoidal with the same frequency, the gain and the 
phase shift being determined by the frequency response (see Appendix A). 

For MIMO systems, the frequency response, G(ju>), is a matrix and, as 
previously seen, its “gain” depends not only on the frequency but also on the 
input direction, that is, on the input combination. Thus, it will be interesting 
to determine the properties of the gain matrix for each frequency, G(jw) = 
Is— jw 

• the rank of the gain matrix, to determine the existence of an imaginary 
zero if it decreases at a given frequency, 

• the extreme gains, <tgUw) and a G (jw), and the condition number, in 
particular, around critical frequencies (bandwidth, cut-off, resonance, ... ), 
as they are used in input/output controllability analysis and closed- loop 
performance and robustness analysis (see Section 8.5), 

• the diagonal dominance, to evaluate the possible effects of interactions if 
a control is applied. The computation of the Gersglrorin radii (3.37), in 
particular at the critical frequencies, allows us to determine a sufficient 
condition that guarantees the system’s closed-loop stability (5.13). 

This kind of analysis for a general frequency response of a MIMO system will 
point out the maximum and minimum reachable gains for a given input direc- 
tion and at a given frequency. The Matlab® command sigma computes these 
gains. Similarly, diagonal dominance can be also determined as a function of 
the frequency . 

Example 3.5. The following Matlab® code 

A= [-2 1 2 .4; 1 -2 1 .6;-. 5 .25 .1 -,05;0.2 .1 .1 -.45]; 

B= [1 . 7 - . 1 ; .11 1 . 4; 0 0;0 0.01]; C=[l -0.2 0 0;-0.3 1.5 0 0]; 
pt=ss(A,B,C,0) ; 

simulates a TITO fourth-order system. Assume two separate output feedback pro- 
portional controllers of gain k p = 4, controlling j/i by ui and y 2 by rt 2 - By using 
(2.51) or the following Matlab® code: 

K=[4 0;0 4]; errclsedloop=f eedback(eye (2) ,pt*K,-l) ; 
eig(errclsedloop) ; 

a stable controlled system is obtained with closed-loop poles located at {-12.27,- 
6. 88, -0.26, -0.4}, the closed-loop error, (r — y), being represented by the function 
errclsedloop. If we compute the extreme error gains as a function of the frequency, 
by means of 

sigma(errclsedloop) ; 

the result being plotted in Figure 3.1, it can be realised that at low frequencies, for 
a given combination of inputs, the error “gain” can reach the value of +14 dB. The 
error gain is reduced below —6 dB in the range of frequencies between 0.3 and 4 
rad, and the controller will be safely efficient only in this range, in the sense that 
it will follow both references with less than 50% error. In fact, the closed-loop error 
static gain is: 
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Go = [I — CA~ 1 BK]~ 1 



( 4.4808 -0.6622 \ 
\ 2.8926 -0.2726 ) 



with a = 5.38 and a = 0.13, showing a possibly inappropriate steady-state behaviour 
unless the desired references always lie in the low-error direction. 



Singular Values 




Figure 3.1. Max/min singular value of the error gain matrix 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: sigma, dsigma. 



System norm. Evaluating the maximum gain, a(G(joj)) , and its maximum 
over all the frequency range, the worst-case amplification for any input signal 
is obtained. The value: 



||G||oo = supcr(G(jw)) (3.38) 

W 

is denoted as the oo-norm of the system. Further details are available in Ap- 
pendix C. 

Example 3. 6. The above closed-loop error function has a worst-case maximum gain 
given by: norm(errclsedloop, inf ) = 5.38, so there exists one reference signal for 
which error “power” is more than five times the set-point. If details on it are needed, 
then the sigma plot provides additional information. 



3.7 System Internal Structure 

After the study of the stability and gain issues, the next part of this chapter 
is devoted to the analysis of the structural properties of a system. That is, 
the connection between input, state, output and disturbance variables. 
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From a control point of view, the final goal is to determine the effect 
of external inputs on the controlled variables, but, in order to design the 
control and to better understand the global behaviour of the system, all the 
interconnections will be relevant. Thus, we will consider the connection of: 

• input-to-state, 

• state-to-output, 

• input-to-output, 

• disturbances as special inputs. 

Although the main interest, from a control viewpoint, is the input/output con- 
nection, the analysis of the interactions with the state is relevant for selecting 
an adequate internal representation for: 

• system implementation, 

• model reduction, 

• appropriate control design method. 



3.7.1 Reachability (State Controllability) 

State controllability is the system property of it being possible to find a con- 
trol input signal to drive the state of the system from one arbitrary state to 
another. The physical interpretation is that directly or indirectly, the input 
vector independently reaches all the system states. To derive a reachability 
test , we will refer to a DT linear time-invariant system and its solution (3.9). 
In particular, after n iterations: 

x n = A n x o + A t '^ 1 Buq + A n ~ 2 Bu\ + • • • + ABu n - 2 + Bu n -\ 

Thus, any targeted state x* = x n will be reachable from xo if there is at 
least one solution of the equation system: 



/ 



u 0 



- A n x o = ( A n ~ 1 B A n ~ 2 B ... AB B) 



\U n - 1, 



If the reachability 2 matrix is defined by: 

C = ( A n ~ 1 B A n ~ 2 B ... AB B) 
we can establish the following: 

2 In many references it is called the “controllability” matrix. 



(3.39) 



(3.40) 
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Reachability test. The system (3.7) is reachable if its reachability matrix, 
C, is full rank. The control sequence could be obtained from: 

( u o \ 

: \=tf{x*-A n x 0 ) (3.41) 

\ 1 / 

where ()' stands for the right pseudoinverse matrix. 

In this case, x* — A n Xo is a linear combination of the columns of C. If 
the rank were ni < n, additional time (additional actions) will not improve 
the result 3 . In the following, unless otherwise stated, it will be assumed that 
x 0 = 0. 



Relative degree of reachability 



Looking at the reachability test, ( rank{C ) = n or n-linearly independent 
columns of C), this is a mathematical test and a number of variations and 
approximations can be considered, leading to different concepts of partial 
reachability. 

If rank{C) = n c < n, only a subspace of dimension n c is reachable. That 
is, under a suitable state representation, the input will not be able to modify 
the value of n ~ n c state variables. To find a state transformation to make 
explicit which state variables are controlled and which are not, we know that 
the independent columns of C determine a base of the reachable subspace. 
The unreachable subspace will be defined by the n — n c vectors orthogonal to 
the columns of C, that is, the solutions of: 

C T x = 0 (3.42) 

This can be computed, for instance, by the Matlab® command null(C’), or 
by singular value decomposition (Section B.4.1). 

Reachable subsystem. To find the similarity transformation to make ex- 
plicit the reachable state variables, take into account the complementary and 
orthogonal character of both subsystems. Thus, given (A, B), with reachabil- 
ity matrix, C = c, compute: 

Tl=subnc=null [c 1 ] ; T2=subc=null [subnc’] ; T= [T2 Tl] 



The T-state transformation will result in: 



*£/c+l — 



f dii d 12 
\ 0 A22 




u k 



(3.43) 



showing that the first part of the state vector is reachable and the second 
one is not. If the unreachable subspace is stable, the system is said to be 
stabilisable. 

3 This matrix construction stops at A n ~ 1 because, by the Cayley-Hamilton the- 
orem, it is well known that A n can be expressed as a linear combination of 
A 1 , i = 0, 1, ..., n — 1 (see Appendix B). 
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Single-input reachability. Instead of considering the full input vector, the 
reachability from a single-input variable can be determined. If the input ma- 
trix B is expressed by B = (&i b 2 . . . b n ): 

rank(Ci ) = rank((A n ~ 1 bi A n ~ 2 bi . . . Abi bi )) = n(i ) (3.44) 

will show the dimension, n(i), of the subspace reachable with input rq. If 
n(i) = n, the whole system is reachable by this input and the pair (A, 6,) is 
said to be cyclic. 

Example 3. 7. Given the fourth-order two-input system defined by: 

0 0 
.1 0 
0 1 
.1 1 

the following properties can be computed: 

• the reachable subspace dimension: rank(ctrb(A,B) ) = 3, 

• the explicit unreachable state variables: 

nc=null ( (ctrb(A,B) ) ’ ) ; c=null (nc ’ ) ; 

T=[c nc] ; Al=inv(T)*A*T, Bl= inv(T)*B 
A1 = Bl = 

0.0000 0.5774 -0.5774 -0.5774 0 0 

2.0000 -0.5000 -0.8660 -1.3660 -0.0366 1.0000 

2.0000 0.8660 -0.5000 -0.3660 0.1366 1.0000 

0.0000 0.0000 0.0000 0.0000 0.0000 0.0000 

showing that the new fourth state variable 

x = T _1 x; X 4 — [0 0.2113 0.7887 - 0.5774]* 

is not reachable. If the uncontrollable mode were unstable, the system would be 
non-stabilisable (there is a “disconnected” unstable state). This would be the 
case if these matrices were from a CT system, 

• the single-input reachability (for ui): bl=B(:,l); rank(ctrb(A ,bl) ) =3. 

Minimum reaching time. Looking at the m x n columns of C, (3.40), let 
us find the first n-independent ones, and form a modified n x n reachability 
matrix as: 

C = (bi Abi . . . A^~% b 2 Abi... A^-% ...b m Ab m . . . A^ m ~ 1 b m ) 

(3.45) 

This arrangement shows that we can use a set of sequences of length p,i of 
actions in the input * = 1, ... m, to drive the system between two states 4 . 
Thus, if 

p, = max pi 

i 

a sequence of p (the system reachability index) inputs will be required to reach 
an arbitrary state: the reachability index is the fastest time any arbitrary state 
can be reached. 

4 pi is called the reachability index of input i. 
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Reachability effort. Rank computation, in theory, involves the evaluation 
of determinants. If the rank of a matrix is n, that means the determinant 
of an n x n submatrix of this matrix is different from zero. However, that 
procedure is numerically unreliable, and rank determination based on the 
SVD decomposition is advised (see Appendix B.4.1). 

The control sequence to drive the state is obtained by multiplying C f by 
the factor related to the desired state ( x * — A n x 0 ). Thus, a norm of this 
matrix will determine the control effort required to reach an arbitrary final 
state or, equivalently, the minimum gain of the reachability matrix (it will be 
the maximum gain of the pseudoinverse) . 

The reachability effort is defined as: 

E p = d(Ct) = -L (3.46) 

These measurements of the degree of reachability can be used to compare 
different control alternatives for the same or different processes. They may be 
also used to determine the suitability of choosing the actuators’ placement. 

Example 3.8. Let us consider the reachable part of the system considered in Ex- 
ample 3.7, and compute some properties: 



All= 

0.0000 

2.0000 

2.0000 



0.5774 

-0.5000 

0.8660 



-0.5774 

-0.8660 

-0.5000 



Bl= 

0.0000 0 
-0.0366 1.0000 

0.1366 1.0000 



• for the two inputs: rank([Bll A11*B11])=3 thus, the reachability time is two 

periods, 2 T, 

• the reachability effort 

svd(ctrb(All , Bll) ) ={1 . 9486 , 1 . 7402 , 0 . 5336} 
svd( [Bll A11*B11] ) ={1 . 7364 ,1.0124,0. 0995} 

is much lower if three periods are used (0.0995/0.5336), 

• the subsystem is reachable with any of the inputs: 

rank(ctrb(All ,B1 ( : , 1) ) ) =3 

svd(ctrb(All,Bl(: ,1))) ={0.3031,0.1270,0.0450} 
rank (ctrb (All ,B1 ( : , 2) ) ) =3 

svd(ctrb(All,Bl(: ,2))) ={1.9319,1.7321,0.5176} 

but the control effort will be much larger for some targets with the first input 
(ay = 0.045), compared with the second one (<r 2 = 0.5176). 

On the other hand, there is not much benefit in using the first input, as two 
inputs have a = 0.534 and the subsystem could only be controlled by the second 
input (a « a 2 = 0.518). 
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3.7.2 Observability 

State observability is a dual property of reachability, but relates state and 
output vectors. The information we get from the system state is through the 
output vector (the sensors). Thus, state observability is a system property 
related to it being possible to compute the state of the system from the output 
observations. The physical interpretation is that, directly or indirectly, all the 
state variables should influence the output in one way or another. To derive 
an observability test, we will refer again to a DT linear time-invariant system 
(3J) - 

Assume an initial state, xo yf 0, and, to simplify the notation, a free 
evolution (uk = 0 , Vfc). The sequence of measurements would be: 

y 0 = Cx o 
y i = Cx i = CAx o 
y 2 = CA 2 x 0 

Vn- 1 = CA n ~ 1 x 0 

or, in matrix form: 





( 2/o \ 




( c \ 




( c \ 






yi 




CA 




CA 




Y = 


2/2 


= 


CA 2 


H 

o 

II 

G 

H 

o 

G 

II 


CA 2 


(3.47) 




\ y n —i ) 




yCA 71 - 1 ) 


1 1 


yCA 71 - 1 ) 





where O is denoted as the observability matrix 5 . Dually, we can establish the 
following: 

Observability test. The system, (3.7), is observable if the observability ma- 
trix, O , is full rank. The initial state can be computed as: 

x 0 = f OY 



where t() stands for left pseudoinverse. 

Relative degree of observability 

Similar to the analysis of the relative reachability, we can define: 

• partial observability. If rank(O) = n 0 < n, the whole state space is not 
observable, and there is a subspace of dimension n — n 0 without any effect 
on the output. This subspace is formed by the non-trivial solutions of: 

5 A similar concept is sometimes called the reconstructivity matrix. 
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0 = Ox* 



i.e., the null space of O. The observable subspace is orthogonal to it, 
generated by the rows of O. If the unobservable subspace has unstable 
dynamics, even if the output trajectories are acceptable, the system will 
sooner or later “blow up” due to the hidden instability. If there is no 
unobservable unstable dynamics, the system is said to be detectable. 

• single output observability. If the observability matrix Oi constructed 
with only the 1-th row of C (denoted by ,;C) (Matlab®, obsv(A,C(i, :)) is 
full rank, the system is fully observable by y t . Otherwise, rank(Oi) = n 0 (i) 
shows the dimension of the observable subspace for this output. 

• observation time. Observability indices (o t ) can be attached to the out- 
puts by sorting the first n-independent rows of the observability matrix: 



O = 



( i c \ 

i CA 

X CA^~ X 



\ v CA u r- 1 ) 



The observability time will be v = max.j{i/j}. 

• detectability degree. Based on (3.47), if the lowest gain of the observ- 
ability matrix is small, changes in the state will not be easily detectable. 
Thus, the detectability degree will be expressed as er(0). 



3.7.3 Output Reachability 

The reachability concept can be also applied to the output instead of the 
state. A system is output-reachable if there is a sequence of control actions 
driving the output from an initial value to a final one. It is easy to derive an 
output reachability test by just looking at the DT convolution (3.11), such as: 
A system is output-reachable if: 

rank([D CB CAB . . . CA^B}) = p (3.48) 

The output reachability time will be the lowest i such that: 

rank([D CB ... CA^B]) = p 

(It will be instantaneous if rank(D) = p). 

Observe that if a system fulfills this property it does not mean that a given 
output can be maintained at a set-point. It only means that this output value 
can be reached at a given time instant. 

All these measurements of the degree of observability can be used to com- 
pare different measurement alternatives and may be also used to determine 
the suitability of choosing the sensors’ placement. 
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3.7.4 Remarks on Reachability and Observability 

It should be emphasised that these concepts are related to the system structure 
and connectivity. No regulation properties can be, in rigour, inferred. 

That is, if a system is fully reachable (output-reachable), it does not mean 
that the system can be regulated around any reachable state (output). Fur- 
thermore, reachability implies bringing the system to an arbitrary state in a 
very short time, and the control effort, (3.46), is a worst-case measure. In reg- 
ulation tasks, the target state is an equilibrium one, and the desired settling 
time is usually substantially larger than the system order. So, the guidelines 
on page 69 are only orientative and must be confronted with other method- 
ologies of actuator selection. Similar remarks can be made about the degree 
of observability, ct(O). In this sense, the concept of input/output controllabil- 
ity, introduced in Section 3.9.1, gives a complementary understanding of the 
control possibilities of a process. 

Partial input (output) vector reachability (observability) is also a mea- 
surement of a controlled system integrity, that is, it allows us to determine if 
a system remains reachable (observable) if there is a failure in some actuators 
(sensors). Fault handling is discussed in Section 9.6. 

Although the development has been justified for DT systems, the following 
remarks are appropriate: 

• continuous-time systems. For CT systems, the reachability and ob- 
servability matrices are the same, although their derivation is a bit more 
complicated. Also applicable are the concepts of degree of fulfillment of 
these properties, although the reachability time has no sense if the control 
input is not bounded, 

• sampled-data systems. If a reachable (observable) CT system is sam- 
pled with sampling period T, the resulting SD system keeps the same 
properties. The only exceptional situation of losing these properties hap- 
pens if the sampling frequency (w s = 2ir /T) is a multiple of any internal 
resonant frequency. 




Figure 3.2. Example electric circuit 
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Example 3.9. For the electric circuit in Figure 3.2, where the state variables are 
the capacitor voltages, Vi, and the outputs are sensed by the current meter shown 
in the figure and a voltmeter in capacitor 3, it is easy to derive the following state 
and output equations: 



d 

dt 





0 



li'2 C '2 

0 



0 

0 

-1 

R3C3 




0^0 

0 0 1 



X + 



1 1 
R-2 R2 
0 0 



u 



+ 



1 

Rif! 

R2C2 

0 



0 



R2C2 

R3C3 



u 



By simple inspection of the reachability and observability matrices (do that as an 
exercise), the following conclusions are easy to derive: 

• the circuit is unobservable (xi is not observable). Only xi is observed by j/i, and 
*3 by y 2 , 

• the system is fully reachable with two inputs. Input 1 controls two state direc- 
tions, except if RiC\ = R 2 C 2 , when it only controls one (two identical circuits 
in parallel). Input 2 controls, in any case, 2 directions (V 2 and V 3 ) 6 . 



3.7.5 Canonical Forms 

A reachable (observable) system can be transformed to canonical representa- 
tions pointing out this property. These representations will be also useful in 
illustrating some control properties, as shown later on in the control design 
chapters. 

Let us assume a SISO system with transfer function: 

. — , / \ bi + & 2 s + • • • + b n s n 1 

G(s) = , 

ai + a 2 s + . . . + a n s n 1 + s n 

It can be represented by the state model in the so-called reachable canonical 
form : 
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• r T - 

1 ( -'c 


bn— 1 
\ b n ) 


(3.49) 



It is easy to verify that this model is reachable and the state variables are the 
derivatives of the first one: 

6 Note that the above conclusions have been obtained under the condition that 
eliminating one input means setting m = 0 , i.e., short-circuiting, and not opening 
the circuit. 




74 



3 Linear Systems Analysis 



d n X i 

dt n 



dxi d l X\ . 

dt dt 1 ’ ’ ’ 

— — = — ; = — > CliXi + U 

dt dtn 



*= 0 



d” 1 xi ctei 

Xi(s) = 



a\ + a 2 s + . . . + a n s n 1 + s n 



(3.50) 

(3.51) 

(3.52) 

(3.53) 



That is, the system can be represented by a chain of n-integrators, the output 
being a combination (6$) of the states. 

In the DT setting, the canonical form implies: 



•Xi+l^k 1 — t — 1, * • * , tl 1 

leading to a chain of pure delays instead of integrators. 

For any other state representation, (A, 13,(7), it is easy to find the simi- 
larity transformation, T c , to obtain the canonical reachable form. First, the 
coefficients at are those of the characteristic polynomial, det(s/ — A). Tak- 
ing into account the special form of A c and B c , by (2.20), the columns of 
T c = [t\ t ‘2 ... t n ] are recursively computed: 



II 


T C B C = B => t n = B 
tn— 1 tl n t n = At n =4* t n — 1 = (A (l n I)t n 


(3.54) 

(3.55) 




t\ = At2 — 0>2t n 


(3.56) 

(3.57) 



with the final check that —a\t n = At\. 

In a dual way, an observable canonical form may be defined, taking the 
output as the first state variable if the transfer function is proper (see, for 
instance, [94] for details). 

MIMO Systems 

Transfer matrix to SS description. By repeating the above realisation for 
a MIMO plant, and stacking all elements together, a state space representation 
(non-minimal, see next section) can be obtained. 

( QQ \ 

q q ) , the above 

technique for each of the elements yields a realisation (Ai, Bi,Ci, Di). The overall 
system can be expressed as: 
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V = 



(A x 0 0 0 \ 
0 A 2 0 0 
0 0 As 0 

\ 0 0 0 a 4 ) 

f Cx C 2 0 0 \ 

^ 0 0 C 3 Ci J 



x + 



x + 



( Bl ° \ 

0 B 2 

b 3 0 

o b 4 J 



u 



Dx D 2 \ 
D 3 Dx J 



u 



(3.58) 

(3.59) 



MIMO canonical forms. For MIMO systems there is the possibility of 
defining some canonical forms. The most well known is the Luenberger canon- 
ical form. It can be shown that any reachable system can be transformed into 
a state representation where there is a chain of /Xi-integrators attached to each 
input component. The procedure can be easily derived [67] and it is illustrated 
in the following example. 

Example 3.11. Let us consider the DT headbox model' (2.69) in page 50. The 
reachability matrix is full rank and the reachability indices are pi = 3 and p 2 = 2. 
The first five columns of the reordered reachability matrix, (3.45), are: 

C = ( bf , i Afbfp A 2 f bf , i bf,2 A f bf, 2 ) 



where stands for the ith column of matrix Bf. 



1. Compute the inverse, C 1 



1 vi 
v 2 
v 3 
v 4 



w 

2. Take the /ii-th and (pi + p 2 )-th rows (denoted as v 3 and vs respectively). 



3. Use the similarity transformation, Tl, composed as: Tl 



4. Compute the canonical form: 



/ v 3 \ 
v 3 Af 
vs A 2 f 

Vs 

\ v s Af ) 



A l = TlAiTZ 1 



0 1 0 

0 0 1 

0 0 0.6065 

0 0 0 

0.7711 -2.0961 0 



0 0 

0 0 

0 0 

0 1 

-0.2865 1.1467 



Bl = TlB( 



0 0 
0 0 
1 0 
0 0 
0 1 



Cl = C f Tl 1 



-0.9315 0 0 0.4923 -0.6321 
0.6585 0 0 -0.2628 0.2908 



In this case, two chains of pure delays appear, ended by the state variables x 3 and 
Xs- 

' Part of this example as well as the case study in this chapter and Chapter 6 have 
been worked out in collaboration with J.V. Roig [4]. 
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3.8 Block System Structure (Kalman Form) 

Now, we are in a position to analyse some structural properties of the system. 




Figure 3.3. Block decomposition 



Similar to the transformation of an internal representation to make explicit 
the reachable and unreachable parts, (3.43), in the general case, the state 
vector may be split into four subvectors involving the four possible combina- 
tions about reachability and observability properties. This canonical structure, 
known as the Kalman form, is composed of blocks, as depicted in Figure 3.3: 
unreachable and unobservable (ncno), 
reachable and unobservable ( cno ), 
observable and unreachable (nco), and 
reachable and observable (co). 

Example 3.12. Let us consider a two-input-one-output system defined by: 

A = 



-0.0450 


-0.4592 


-0.1223 


0.3892 


0.4659 


-2.2628 


0.3591 


0.7119 


1.1125 


0.4726 


-1.3667 


0.0886 


-0.8736 


-0.2277 


1.1511 


-0.4256 


0.4513 


0.1423 






0.3791 


0.5195 






0 . 5774 


0.0000 






0.5650 


1.3076 






0.4513 


0.3791 


0.5774 


0.5650 



The system is unreachable and unobservable as the “practical” controllability and 
observability ranks are 2: 

c=ctrb(A,B) ; svd(ctrb(A,B) )=2 . 1210 1.2338 0.0007 0.0001 

o=obsv(A,C) ; svd(obsv(A, C) ) =4 . 8097 1.0047 0.0000 0.0000 

Moreover, as rank([c’ ;o])= 3, there is a subspace (dimension 1) which is ncno. 
The system decomposition is obtained as follows 8 : 

8 Those commands were typed for a system whose state-space model had more 
precision in the coefficients. Copying the above matrices ( A , B, C) yields rank 
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ncno=null( [c 


’ ; o] ) ; ncno ’ = 


-0.7604 


-0.2387 


0.5774 


0.1776 


nco=null ( [c ’ 


;ncno’] ) ; nco’ = 


-0.3502 


0.8830 


0.0000 


-0.3127 


cno=null ( [o ; 


ncno’] ) ; cno’ = 


-0.3090 


0.1404 


-0.5774 


0.7426 



co=null ( [ncno ’ ; nco ’ ; cno ’ ] ) ; co> = 0.4513 0.3791 0.5774 0.5650 

By the similarity transformation T, T= [co cno nco ncno] ; : 

Ad=inv(T)*A*T = 



-0.1000 


0.0000 


- 1.0000 


0.0000 


0.0000 


- 1.0000 


0.0000 


2.0000 


0 


0.0000 


-2.0000 


0.0000 


0.0000 
inv(T) *B= 


0.0000 


1.0000 


- 1.0000 


1.0000 


1.0000 






0.0000 


1.0000 






0.0000 


0.0000 






0.0000 


0.0000 






: C*T= 








1.0000 


0.0000 


0.0000 


0.0000 



a block decomposition is achieved. By this decomposition, the reachability and ob- 
servability properties are derived by inspection. In this case: X 2 and xa are unob- 
servable and X 3 and xa are unreachable. Thus, only the state xi links the input and 
output of the system. 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: ctrb, ctrbf , obsv, obsvf, null, rank,svd. 



3.8.1 Minimal Realisation 

If we compute the transfer matrix of a state space representation, only the 
reachable and observable subsystems will appear. Thus, in a Kalman form 
representation, only the co subsystem is required to implement the trans- 
fer matrix. State space representations without unreachable or unobservable 
modes are denoted as minimal realisations. 

Example 3.13. Let us consider again Example 3.12. The transfer matrix is: 

4 for controllability and observability matrices (!), but there is no error in the 
procedure. This is one of the reasons that justifies the need for SVD in practical 
cases with imprecision (as in this case, “only” four significant digits). The numer- 
ically reliable way of obtaining ncno is typing [u s v] =svd( [c ’ ; o] ) , realising 
how low the last diagonal element in s is, and, assuming it to be zero, taking the 
last column of v as a basis for ncno. 




78 



3 Linear Systems Analysis 



g=tf (S) ; gf =zpk(g) 

Transfer function from input 1 to output: 

s~3+4s~2+5s+2 (s+2) (s+1.009) (s+0.991) 



s~4+4 . ls~3+5 . 4s~2+2 . 5s+0 . 1999 (s+2) (s+1 . 009) (s+0.991) (s+0 . 09996) 

Transfer function from input 2 to output: 

s~3+4s~2+5s+2 (s+2) (s+1.009) (s+0.991) 



s~4+4 . ls~3+5 . 4s~2+2 . 5s+0 . 1999 (s+2) (s+1 . 009) (s+0.991) (s+0 . 09996) 

So, both elements are identical and some terms cancel. Thus, the transfer matrix 
will be: 

2/0) = i 1 O^O) 

This result could be extracted directly from the Kalman form, just considering the 
first-order co-subsystem. The number of states in the minimal realisation can be 
evaluated by the rank of the product of the observability and controllability matrices. 

As previously seen, the concept of “minimal realisation” is connected to 
cancelling terms in the state representation, but it also has the same meaning 
dealing when with transfer matrices. 

Let us consider this reduction, for the sake of clarity, in a SISO case. 

Example 3.1 4- Given the transfer function, in factorised form: 

_ (s + 3.02)(s + 1.04) (0.00071s + 1) 

9(S) ~ (s + 4)(s + 2.994)(s+ 1.012) 

some pole-zero cancellations clearly appear. Let us look for a state representation 
of g(s) and its properties, 

n =[0.0007 1.0029 4.0622 3.1408]; 

d =[1.0000 8.0060 19.0539 12.1197]; 
g=tf (n, d) ; 

[A,B,C,D] =tf 2ss (n, d) 
rank(ctrb(A ,B) )= 3 

rank(obsv(A ,C) )= 3 

svd(ctrb(A,B) ) = {46.4732,0.4762,0.0452} 
svd(obsv(A,C) ) = {83.1521,0.0672,0.0015} 
svd (obsv ( A , C) *ctrb(A , B) ) ={265 .1,0.03,0.001} 



pointing out that there is only one mode that matters for controllability and observ- 
ability. Proceeding as before, but giving greater tolerance to the reachability and 
observability computation, only one state will remain. For example: 

rank (obsv (A ,C) , 0 . 1) )=1 

A more systematic approach to model reduction is presented later on in Sec- 
tion 3.10. 
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Example 3.15 (Headbox system). Let us now consider again the simple model of 
the headbox, and look for a mathematical internal representation without looking 
at the physical interpretation of the state variables. 

Taking the DT transfer function in (2.68) (including the delays), and using the 
Matlab® command: 



[An, Bn, Cn, Bn] = ssdata(G(l,l)) 

a realisation of the first TF element is obtained. To get the full realisation we can 
proceed in different ways: 

a) Repeating the sequence above for each element of the DT transfer matrix. 
This will lead to an augmented state representation, surely unreachable and 
unobservable. 

b) Reducing to a common denominator the elements of G{z) by columns and 
realising with the same state variables all these transfer functions. Attached to 
each input (column) a reachable subsystem will be realised. In this case, the 
global system could be unobservable. 

c) Doing the same by rows, to get a set of p observable subsystems. The global 
system could be unreachable. 

Let us illustrate the first option, obtaining ( A,-,- , 





[■ 0.6065 0 0] 
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An = 
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; Bn = 
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1 0 




0 



Cn = [0 0 0.3935] ; flu = 0 



An = [0.3679] ; B 12 =[l]; C 12 =[ -0.6321 ] ; D 12 = 0 

A 2 i=| ) V ^ I ;B 2 i = | " | ;C 21 = [0 0 0.049 0.038] ;D 21 =0 

C 22 = [0.2908 -0.2628] ; D 22 = 0 
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The global system would be: 



A = 



'An 
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0 


0 




"Bn 
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Ai 2 
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0 


; B = 
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Bl2 
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0 


A 2 i 
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B 2 1 
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a 22 _ 




0 


b 22 _ 



C = 



Cn Ci 2 0 0 

0 0 C 2 i C 22 



D = 



Du D12 
D 2 1 D 22 



We know that this is a fifth-order system, but we obtained a 10-dimension state 
vector. This means that there are five extra states which are unreachable, unob- 
servable or both. We can check that the system is unreachable and unobservable by 
computing the rank of the reachability and observability matrices. To reduce the 
model, the Matlab® command 



[Am, B m , Cm, D m ] = minreal(A, B, C, D, tot) 
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will provide a minimal realisation, such as: 



A 



m 



0.9755 -0.0237 -0.0864 -0.0658 -0.0521 
0.0352 0.5262 -0.0956 -0.4850 0.5282 
1.0630 -0.0770 0.0364 -0.0374 -0.1158 
0 -0.0145 0.9184 -0.0161 0.0007 

0 -0.0349 -0.3802 0.2921 0.2312 



B 



m 



-1.4057 0.0593 
0 -0.5369 

0 0.1122 

0 -0.3741 

0 -1.1259 



C m = 



0 0 0 -0.0471 0.5771 
0 0 0 -0.1256 -0.2165 



The argument ’tol’ allows for defining the tolerance in admitting a matrix as singu- 
lar 9 . 

Of course, the Matlab® command 



Gd=tf (ss (Am,Bm,Cm,0) ) 

will return the original transfer matrix. The Matlab® command ss, applied to the 
full matrix G also yields a state space representation in one step. 



3.8.2 Balanced Realisation 



A balanced realisation is a minimal realisation where each mode has the same 
relative degree of reachability and observability. In particular, as a very special 
case, a realisation with the same reachability and observability matrices is 
balanced. 



Example 3.16. Let us consider again Example 3.14, where the system has a third- 
order model (A, B, C, D). The transfer function is: 



S(s) 



0.00071s 3 + 1.003s 2 + 4.062s + 3.141 
s 3 + 8.006s 2 + 19.05s + 12.12 



or, pointing out the related factors (poles and zeros): 



g(s) 



(s + 3.02)(s + 1.04) (0.00071s + 1) 
(s + 4)(s + 2.994)(s+ 1.012) 



g(s) = 0.2591 



1 + 0.3311s 1 + 0.9615s 1 + 0.00071s 
1 + 0.334s 1 + 0.9981s 1 + 0.25s 



Compute a similarity transformation to get the Jordan canonical form: 



[T, J] =jordan(A) ; 

T= J= 

0.1729 5.3225 -4.4954 -1.012 0 0 

-0.1709 -1.3306 1.5015 0 -4. 0 



In fact, the minreal command uses the argument ’tol’ to delete the modes attached 
to the lowest singular value of C or O, as outlined in Example 3.12. 
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0.1689 0.3326 -0.5015 0 0 -2.994 

Bj=inv(T)*B= [111]’ 

Cj=C*T= [0.0095 0.9626 0.0252] 

Dj =0.0007 

This means: 

a(s) 

Thus, the realisation: 

Ab= J; Bb = [VO. 0095 V0.9626 ^0.0252] T ; Cb = [V0.0095 ^0.9626 V0.0252] 

will be balanced, because with Bb = Cb T and Ab = J being symmetric, the reach- 
ability and observability matrices are identical. 

There are other interpretations of the concept of “balancing” [133], ori- 
ented towards model reduction with minimal error (and this is the chosen im- 
plementation for balreal, in Matlab®, used in Section 3.10.2). For brevity, 
they will be pursued no further. 

Matlab®: Some commands implementing algorithms related to the contents of this 
section are: minreal, balreal, canon. 



= 0.0007 + 



0.0095 



0.9626 0.0252 

+ — — + 



s + 1.012 s + 4 s + 2.994 



3.8.3 Poles and Zeros 

The concept of poles and zeros in MIMO systems is a bit more complicated 
than in SISO systems. Let us summarise the basic differences. 

Poles 

It has been already mentioned in page 41 that the poles of a MIMO system, 
(A, B,C, D), are determined by the system matrix, being pi = A ,;(/!). But, 
looking at the previous results for the system structure, it is clear that some 
of these poles (those unreachable and/or unobservable) will not appear in the 
input/output model. We said that the poles are generators of signal modes, 
but, in this case, only those connected with the input and output vector could 
be excited or their generated signal sensed. 

Transfer matrix representation. In Section 2.6.2, a procedure based on 
the partial fraction expansion of the transfer matrix allowed us to determine 
the pole multiplicity. The poles of a transfer matrix can also be computed as 
those of the least common multiple of the denominators of all the minors of 
the transfer matrix. 

Let us review this approach, relating it to the minimal realisation results. 
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Example 3. 1 7. Consider the transfer matrix: 



Y{s) = ( 2 IU 5 i ) U(s) 

\ s+l s + l / 

We realise that there are poles at s = — 1 and s = —2. If a state representation of 
each element is carried out, the total system would be: 





/-I 0 0 0 \ 




( 1 o\ 




0-200 




0 1 


X = 


00-10 


X + 


-1.5 0 




^ 0 0 0 -1 ) 




l 0 2) 



(1 1 0 0 \ 

^0 0 1 l) 



x + 




u 



It is easy to check that this fourth-order system is not a minimal realisation. Either 
by looking at the minimal realisation or proceeding like in Section 2.6.2, a double 
pole in s = — 1 and a single one at s = —2 are obtained. The third pole in s = — 1 
does not belong to the co-subsystem. 

y(s)= ((20) + (-1.52) CTT) + ( 2 J) (iT 2 )) 



where the first term of the right-hand side is the direct input/output coupling matrix 
(D), the instantaneous gain matrix, and the rank of the numerator matrix of pole 
in —1 is 2, and that of —2 is 1. 

Regarding the determinant-based methodology, the first-order minors are the 
elements of the matrix, with poles in —1 and —2. If we compute the second-order 
minor, that is, the determinant of the transfer matrix, it would be: 



In [17] := G={-[1/ (s+l) ,1/ (s+2)d,{(2s+.5)/(s+l) ,2/(s+l)}> 

In [18]:= Simplify [Det [G] ] 



yields: 



-2 (-1.20377 + s) (1.45377 + s) 
(1 -(- s) (2 + s) 



so the least common multiple is indeed (1 + s) 2 (2 + s). 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: eig, pole, mpole, damp, ss2zp, tf2zp. 



Zeros 

Dually to the poles, the zeros can be considered as signal sinks (notch or 
blocking filters). If a SISO system presenting a zero at s = z is excited by 
an input, u(t) = e zt , the output only contains components from the system 
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modes (poles), and the components Ae zt are “blocked”. In this case, the zeros 
are the roots of the transfer function numerator polynomial. 

In MIMO systems, it was pointed out in Section 2.6.2 that the zeros are the 
values of s reducing the rank of G(s). This means that the previous blocking 
effect appears if the exciting signal is applied in a given direction, so the 
concept may be refined with directionality issues. 

Zeros can be computed as the values of s such that, replacing below y(s) = 
0, the matrix equation 



(si- A -B\ (x(s)\ _ ( 0 \ 
1, C D )\u{s))-\y{s)) 



(3.60) 



has a non-trivial solution for x, u, i.e., the determinant of the left-hand side 
matrix vanishes. In this way, non-zero input would be “blocked” from appear- 
ing at the output. 

Transfer matrix. They can be also computed as the roots of the numera- 
tor of the transfer matrix determinant if all the poles, with their respective 
multiplicity, appear at the denominator. 

Example 3. 1 8 . In the previous example, the zeros may be computed using the G(s)~ 
determinant. It was: 

-2 (-1.20377 + s) (1.45377 + s) 

(1 + s) (2 -f- s) 

all the poles appearing in the denominator. 

Alternatively, using the internal representation (3.60) and Mathematica® : 

In [36] := PP={{s+l ,0 ,0 , -1 ,0} ,{0, s+2 ,0 ,0,-1}, 

{0,0,s+l, 0,-1}, {1,1, 0,0,0}, {-1.5, 0,2, 2,0}} 

Factor [Det [PP] ] 

Out [36]= -2(s-l. 20377) (s+1. 45377) 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: ss2zp,tf2zp,zero,tzero. 



If a state representation, a system realisation, is not a minimal one, that 
means that some modes or poles are unreachable or unobservable. Thus, the 
corresponding system matrix eigenvalues will not appear as transfer matrix 
poles. In this case, we will consider that there are cancellation or decoupling 
zeros. 

For instance, if a system is expressed in the Kalman form: 



'All 0 A13 0 




Bl" 




'Cl 


A21 A22 A23 A24 


; b = 


B2 


; c T = 


0 


0 0 A33 0 


0 


C3 


0 0 A34A44 




0 




0 
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the eigenvalues of A 22 are output decoupling zeros and those of A33 are input 
decoupling zeros. The eigenvalues of A 44 could be considered in both classes. 
The input/output poles are the eigenvalues of An, and the “true” transmis- 
sion zeros are those from {An, B 4 ,C 4 , D). 

As is well known, the riglrt-half-plane (RHP) zeros, introduce additional 
difficulty in controlling a system. Systems with RHP zeroes are denoted as 
non-minimum-phase ones (NMP). They produce what it is called an inverse 
response. That is, for instance, if a step input is applied, the response goes in a 
sense (positive or negative) and the final value is of opposite sign. Dealing with 
MIMO systems, the multivariable zeros are not correlated with the zeros of the 
SISO transfer functions relating each pair input/output. Thus non- minimum- 
phase multivariable zeros may appear even in the case that no single transfer 
function has such a kind of zero. Further issues with RHP zeros are discussed 
in Sections 5.3 and 8.3.2. 

Also it is worth realising that a MIMO system may have individual zeros 
in the same position as MIMO poles, without cancelling, as the example below 
shows. 



Example 3.19. The system: 



G(s) 



(s+l) 

0 



° "1 

(s + l) 

0 > + 2) J 



has poles in {-1,-2} as well as one zero at { — 1}, but they do not cancel: they 
belong to different internal variables. In general, they will act in different directions. 

Another interesting property is that, for square plants, its poles are the zeros of 
the inverse and vice versa. 



3.9 Input/Output Properties 

Knowledge about the internal structure of a system provides criteria for: 1) 
selecting the placement of actuators and sensors to reach all the interesting 
parts of the system to be controlled and 2) pruning the irrelevant internal 
variables or the spurious variables appearing in the process of transforming 
the model representation. The partial degree of reachability and observability 
also helps in understanding its dynamic behaviour, as previously mentioned. 

But once these properties have been verified, nothing is said about a num- 
ber of issues that matter for control purposes: 

• is it possible to keep the outputs (or the controlled variables) of the system 
at the set-points? 

• is it possible to drive the outputs (or the controlled variables) tracking 
some references? 

• how large control actions are required? 

• is there any risk for hidden instability to appear? 

• are the theoretically required controllers feasible? 
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• are there numerical problems in computing the system properties? 

• is it possible to reject the disturbances? 

• which uncertainty in the process model or in the disturbance knowledge is 
tolerable to keep some control properties? 

All these properties are better connected to input/output process character- 
istics and should be analysed once the structural properties are fixed. 



3.9.1 Input/Output Controllability 

Most of these properties are summarised in the so-called input/output con- 
trollability. Unfortunately, there are not so clear criteria for evaluating the 
input/output controllability of a process, and even the definition of the con- 
cept is not unanimous in the literature. We will accept the following definition: 

A system is input/output controllable if it is possible to implement a 
control system suitable for matching the control requirements in ref- 
erence tracking and disturbance rejection, in spite of uncertainties in 
the process model. 

In rigour, to assess I/O controllability, based on the above definition, the 
only way to prove it is by designing a suitable controller. However, to assess the 
“possibility” of finding such a controller before investing effort in its design, 
some elementary tests can be carried out, based on the same ideas as those 
illustrated in Example 3.5. 

Perfect controller. Given a plant model, y = Gu + Gdd, and a set-point, 
r, an “ideal” controller would apply u = G~ l (r — Gdd). As commented in 
Section 3.5, input scaling is assumed to map [— 1,+1] onto the operational 
actuator range. Then: 

• an obvious condition is that the number of control inputs should be equal 
to or larger than the number of controlled variables (m > p) if arbitrary 
set-points on them must be pursued, 

• for disturbance rejection, scaling so that the maximum expected dis- 
turbance has unit magnitude, the ideal controller might be feasible if 
a(G~ 1 Gd) < 1, i.e., the worst-case disturbance to ideal input gain does 
not imply actuator saturation, 

• for reference tracking, scaling outputs so their desired range is mapped 
onto [—1, 1], the condition is a(G _1 ) = a(G) > 1, 

• for tolerance to uncertainty and reasonable “invertibility” , the condition 
number of G should be “small” . 

These conditions may be evaluated at different frequencies to assess at 
which frequencies ideal control is possible. However, if the zero-error target is 
relaxed, allowing for certain admissible deviations, the above conditions can be 
relaxed a bit, but get more complex. The reader is referred to [119] for details. 




86 



3 Linear Systems Analysis 



These conditions can be used as a guide for actuator placement, complement- 
ing reachability-based ones, or as a guide for determining the maximum level 
of performance achievable on a particular configuration. 

Limitations on achievable performance 

Feasible controller. Note that the above analysis refers to an ideal control 
and not to a “practical” control. The possibility of practical implementation 
implies some constraints in the control, in addition to the already (approxi- 
mately) considered saturation bounds: 

• the controller should be realisable (finite high-frequency gain 10 ). The high- 
frequency gain limitation is also needed to avoid amplification of measuring 
noise and to tolerate modelling errors (see Chapter 8), 

• unstable poles or zeros cannot be cancelled, 

• delays cannot be inverted, 

• enough and appropriate control actions should be available (related to the 
conditioning and minimum-gain issues commented on above). 

Based on these constraints, it is clear that there may be lots of additional 
issues to discuss apart from those related to the controller: there are process, 
or model, limitations to achievable performances. If an assessment of these 
limitations is carried out in the starting phase of controller design, then, if 
they are unacceptable, a process redesign or model re-identification might be 
advised. 

Some of these issues will be discussed in future chapters, as more notions 
on different solutions to the control problem are presented. However, they are 
summarised below, as it is important to point out that: 

limitations must be considered as process-model properties, indepen- 
dent of the to-be-designed controller. 

First, ideal control (involving matrix inversion) is not achievable, as some 
of the above considerations regarding feasible controllers usually apply. How- 
ever, there is a bunch of subtle limitations, only appearing when a detailed 
analysis of the frequency domain behaviour of the process is carried out. Just 
to mention the more apparent ones: 

• the disturbances acting on a range of frequencies over the bandwidth of 
the actuators cannot be cancelled, 

• the measurement noise frequency range may be within the desired band- 
width, 

• the achievable bandwidth is limited if there are RHP zeros (for high gain 
the system becomes unstable), 

10 The process is invertible with finite high-frequency gain only if the direct in- 
put/output coupling matrix D is full rank. However, that situation is unusual. 
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• open-loop unstable plants have lower bounds in bandwidth (feedback is 
needed to stabilise the plant but bandwidth, in general, increases with 
loop gain), 

• combining both previous reasons, open-loop unstable plants with RHP 
zeros are difficult to stabilise, 

• uncertainty in the model limits achievable performance targets to ensure 
that simulated results are consistent with practical implementation. 

As previously mentioned, details on these aspects will be discussed in 
Chapters 7 and 8. 



3.10 Model Reduction 

It is rather common to represent a dynamic system with a model whose order 
is higher than required to fulfill a control purpose. In the case of a process, 
a state model derived from an input/output representation may present un- 
reachable and unobservable modes that must be pruned. Also, as seen in other 
examples, there are modes with small influence, due to either an approximate 
cancellation with poles or because their timescale is out of our range of inter- 
est. 

There are control design techniques leading to higlr-order complex con- 
trollers. This is the case in cancellation controllers and in many of the model- 
based control design approaches. 

In many cases, to achieve some controlled process performances, it suffices 
to use or to implement a simplified, reduced order, dynamic system. Reduction 
means approximation. Thus, in a reduced order model, some properties of the 
original system are captured but some other may be lost. Let us consider 
two typical approaches: approximating the dynamic behaviour keeping the 
same static gain, and approximating the behaviour at some critical range of 
frequencies, without taking care of the steady-state. 



3.10.1 Time Scale Decomposition 

Given a dynamic system (A, B , C, D ), if there are two different time scales of 
behaviour, it can be decomposed into two subsystems such as: 



( ^ - 


An A12 
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where e is very small. 

• slow behaviour. If, in the limit, it is considered that e — > 0, the derivative 
term of the second state subvector vanishes. Thus, the solution of 



0 = A 2 iXi + A 2 2X2 + B 2 u 
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will determine the value of X 2 ' 



X2 = A 22 (- 421*1 + B 2 u) 



The reduced order system will be: 

Xi = (An — Ai 2 A 22 A 2 i)xi + (Bi — Ai 2 A 22 B 2 )u 

and the fast behaviour, characterised by the state subvector X2 is consid- 
ered as instantaneous. This approximation is called residualisation, 

• truncation. Assume a similarity transformation, T, in such a way that 
A12 = A 2 i = 0 and An and A 22 are block-diagonal (Jordan canonical 
form), being A(An) <C A(A 2 2 ). The dynamics of the state subvector X2 
components is much faster and they can be deleted. 

Keeping the model (An,Bi,C{), the contribution of the fast modes has 
been removed. This simplest reduction does not keep the same static gain 
of the model, 

• fast behaviour. Alternatively, to analyse the transient behaviour or the 
fast mode response, a timescale change such as t = er will lead to the new 
state equation: 

/ 1 dx 1 \ 

y J = Ax + Bu 

Proceeding as before, e — > 0, the derivative of the first state subvector 
vanishes, that is, x\ (r) = xi remains constant, and the system dynamics 
is characterised by: 



dx 2 _ 

— , — = ^ 22*2 + A 2 iXi + B 2 U 
dr 

Example 3.20. Let us consider the manipulation of a tank level, h, by means of a 
valve, whose dynamics is characterised by a time constant of r = 40 ms. The partial 
transfer functions are: 

, 1 _ 10 _ 2 

9t(S> (s + 1)’ 9v (1 + 0.04s) 
so the global model is G(s) = gv(s)gt.(s). A state space model could be: 



x v = —25x v + 50u 
x t = —x t + 10a:„ 



It can be written (with e = 0.04) as: 



ex v 




■ 0 - 1 ' 
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x t _ 
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Xt _ 
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0 


u 



If e — > 0, x v ss 2 m and the approximate model becomes it = —Xt + 20rt. It will allow 
us to study the dynamics of filling the tank, assuming an instantaneous behaviour 
of the valve. 
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On the other hand, if the model is rewritten assuming a timescale of 10 ms, 
taking e = 0.01, the state representation would be: 
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For e — > 0, it —> > 0, that is, Xt = const, and the reduced model will be x v = 
— 2.5®,, + 5u, allowing for the simulation of the valve dynamics. 



3.10.2 Balanced Reduction 



Reducing the model order, other than the timescale, the input/output rele- 
vance of each mode may be directly considered. In a balance realisation, the 
less reachable (and observable) modes are candidates to be deleted. 

Example 3.21. Let us consider again Example 3.14, where the system was repre- 
sented in a balance realisation by: 

Ab = diag[- 1.012 -4 - 2.994]; Bb T = Cb = [V0.0095 V0.9626 V0.0252] 

It appears clear that the second pole is the one contributing more to the in- 
put/output relationship. Again, to get a reduced (first) order model we can truncate 
or residualise the system ( Ab , Bb, Cb). 



Example 3.22. Let us consider the SISO system: 

1 _ 0.1 1 10 _ 0.1122 -0.1235 0.0112 

9 S ’ ~ (s + 0.1)(s + l)(s + 10) “ s + 0.1 s + 1 s + 10 " s + 0.1 s + 1 s + 10 

The following reductions can be obtained: 

• by deleting the factor « 1 (residualisation) : 

, , 0.1 

fll(s) (s + 0.1)(s + 1) 

• by deleting the term ^'^q 2 ~ 0 (truncation): 

, . -0.0113s + 0.0998 

92{S) = (s + 0.1)(s + 1) 

• by reducing the term ~ 0.00112 (residualisation): 



g 3 (s) = 0.00112 + 



-0.0113s + 0.0998 
(s + 0.1)(s + 1) 



Alternatively, getting a balanced state space realisation (Ab, Bb, Cb, Db) 

[A,B, C ,D] =tf 2ss (1 , [1 11.1 11.1 1]); 
s=ss(A,B,C,D) ; 
sb=balreal(s) ; 

[Ab , Bb , Cb , Db] =ssdata(sb) 
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and applying a balanced truncation (modred(sb,3, ’del’)) or, alternatively, resid- 
ualisation (modred(sb,3)): 

rsb=modred(sb,3) ; 
gbl=tf (rsb) 

0.0007249 s~2 - 0.009611 s + 0.09962 

gb l= 

s~2 + 1.096 s + 0.09962 
rsb2=modred(sb, 3 , ’del’ ) ; 
gb2=tf (rsb2) 

-0.007277 s + 0.09648 

gb2= 

s~2 + 1.062 s + 0.09655 

The behaviour of all the models is rather similar, but differences may be detected at 
given frequencies, in particular the static and instantaneous gains. For comparison, 
the norm (maximum difference in frequency-response) of the modelling error can be 
calculated: 

norm(s-gl , inf )=0 . 0091 , norm(s-g2 , inf )=0 . 002 

norm(s-g3, inf )=0 . 0011 , norm(s-gbl , inf )=norm(s-gb2 , inf )=7 . 25e-04 

Example 3.23. Let us now consider a simple academic MIMO system, to illustrate 
the reduction of “common” poles hidden by the approximation implied in an experi- 
mental identification. In the example below, everything is clear by just looking at the 
transfer matrix, but the approach could be applied with similar success to models 
not so evident, as the balanced reduction detects that situation autonomously. 
Assume an experimental model, G(s), and its approximation: 

G(*)s[jjj? JF 1; G a (s) = f# fFl «G(s) 

. 3 + 1.1 3 + 2.1 J L 3+1 3 + 2 . 

pointing out that the system could be, in fact, approximated by a second-order 
system, the two outputs being proportional. 

If we type in Matlab® an immediate realisation of G (A,B,C,D): 

A= [-1 0 0 0 ; 0 -2 0 0;0 0 -1.1 0;0 0 0 -2.1]; 

B= [1 0;0 2 ; 2 . 1 0;0 4] ; C= [1 1 0 0;0 0 1 1]; 

and apply the following sequence of commands: 

s=ss(A,B,C,0) ; 
g=tf (s) ; 
sb=balreal (s) ; 

drsb=modred(sb, [3 4] , ’del’) ; drg=zpk(drsb) 
the second-order reduced model is: 

TF from input 1 to output . . . from input 2 to output . . . 

1.038 (s+2.075) 2.0383 (s+1.077) 



# 1 : 



(s+2.077) (s+1.078) 



# 1 : 



(s+2.077) (s+1.078) 
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2.0796 (s+2.075) 3.979 (s+1.077) 

# 2 : # 2 : 

(s+2 . 077) (s+1 . 078) (s+2 . 077) (s+1 . 078) 

This model keeps the high-frequency behaviour of the original plant (check it by 
plotting sigma(g-drg) ), but not the DC gain. Note that, as an alternative, we may 
keep the DC gain assuming instantaneous behaviour of the to-be-deleted subsys- 
tem ( residualisation ), yielding in this case a nonzero D matrix in the state space 
representation. The approximated model would be then more complicated, with an 
additional zero at each element of the transfer matrix: 



rsb=modred(sb, [3 4]); rg=zpk(rsb) 
TF from input 1 to output . . . 
-0.037152 (s+2. 073) (s-29.01) 

# 1 : 

(s+2. 076) (s+1. 076) 



from input 2 to output... 
-0.018918 (s+1. 076) (s-109.8) 



(s+2. 076) (s+1. 076) 



0.019995 (s+2.073) (s+102.9) 0.010401 (s+1 . 076) (s+380 . 4) 

# 2 : # 2 : 

(s+2 . 076) (s+1 . 076) (s+2 . 076) (s+1 . 076) 

The norm of the modelling error is 0.047. The DC gain has maximum gain 3 and 
minimum gain 0.001, so if the modelling error were in the direction of the lower DC 
gain associated vectors, the simplification might not be appropriate (the plant is 
severely ill-conditioned at steady-state). Residualisation (keeping DC gain) in this 
case seems more appropriate, as the first truncated model has 10 times more gain 
in the lowest direction than that of the real plant G 11 . 



3.11 Key Issues in MIMO Systems Analysis 

In order to characterise the behaviour of a controlled plant, as well as to 
initially validate a control system design, a bunch of analysis tools should be 
available. The goal of these tools should be not only to evaluate a given system 
but also to provide rules of thumb about how to improve some desired perfor- 
mances or to avoid some constraints’ violation. A key concept introduced at 
the very beginning is that the control system cannot make “miracles” : in the 
end, the control system is selecting the best action among the possible ones 
to reach some goals. If the process is not capable of performing in the desired 
way, no controller will do the job. 

Thus, a crucial part of the analysis of a controlled system is the per- 
formance limitations. This could recommend us to think about process 

11 In most cases, keeping the DC gain is not necessary to get a good approximate 
model for closed-loop control, as low-frequency errors may be easily compensated 
for by integral action. Other frequency ranges are indeed more important, as 
discussed in Chapter 8. 
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changes before the control design is initiated, including the integrated process- 
controller design. This is nowadays a hot topic, being an active subject of 
control research and process design. 

Structure evaluation. Structural properties are among the main factors in 
limiting the achievable performances. This has a lot to do with the selection 
of variables. The addition of a sensor or actuator or the appropriated pairing 
of variables, a matter to be discussed in the next chapter, may improve the 
structure of the process, allowing for better controlled performances. 

We must consider the process structure and model from the control view- 
point. It is worth recalling that a good model for control does not mean a 
good model for other purposes, for instance, to predict the process output. 

Gains. Directionality is also a fundamental issue in MIMO systems. It is 
sometimes surprising that systems behaving properly when a single loop is 
analysed present an unacceptable behaviour under simultaneous changes in 
the whole system. The advantages and drawback of the interaction should be 
taken into account to look for the appropriated control structure. 

Performance evaluation. The worst-case condition should be considered 
to evaluate the performances of a MIMO system. Even without uncertainty 
in the model, unexpected behaviour may appear for some input combination. 



3.12 Case Study: Simple Distillation Column 



In the column shown in Figure 3.4, with lateral extractions, the concentration 
of the extracted flows ( D , D\ and D 2 ) is controlled by manipulating their 
flows, the concentration of the (constant) inlet flow, dp, acting as a distur- 
bance. 

This process, with the particular selection of input and output variables, 
presents an interesting triangular structure. Note that if the bottom product 
extraction flow is also manipulated, strong interaction will appear. 

Based on an experimental modelling run, the following transfer matrices 
have been approximated: 

• output concentration increments versus extracting flows changes (transfer 
matrix G(s)): 



Z\V(s) 



r 0.7e“ 3s 
18.5s + 1 



5e 



-1.23s 



14.6s + 1 



0 



0.58 

10.3s + 1 



0 

0 



(-AU(s)) 



0.25 3.65 1.65 

L 9.4s + 1 14.25s + 1 9.8s + 1 J 



• concentration increments of outlet flows vs. that of inlet flow: 
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Figure 3.4. Distillation column 



G d (s) 



AY(s) 

AcIf(s) 



r 0.6e _1,6s 1 
18.3s + 1 

5.2 

15s + 1 
20 

L 9.5s + 1 J 



a) Reduced minimal DT realisation. For control purposes, we would like 
to get a DT reduced-order model, but it should be validated comparing the 
time-responses. Thus, the following actions are taken: 



1. Reduce the transfer matrix elements, using the following time constants 
for the approximate transfer functions: r = 10, 14.6, 18.4 s. 

2. Use a sampling period T = 1.5 s, and get the ZOH equivalent DT transfer 
matrix, G(z). 

3. Obtain a minimal realisation ( A , B , C , D ) using as many physical variables 
as possible. 

4. Compare the CT full model step response with that of (^4, B , C, D). 



1. Model reduction 



This rough approximation, also considering delays that are multiple of the 
applied sampling period, will lead to: 



f 0.7e“ 3s 


0 0 

0.58 n 




f 0.6e -1 ' 5s 1 


18.4s + 1 
5e _1 ’ 5s 


; G d {s) = 


18.4s + 1 
5.2 


14.6s + 1 


10s + 1 u 


14.6s + 1 


0.25 


3.65 1.65 




20 


L 10s + 1 


14.6s + 1 10s + 1 J 




L 10s + 1 -1 
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2. Discretisation 

Element-by-element discretisation using, for instance, the Matlab® command 
c2dm with the zoh method, yields the transfer matrices: 



r 0.0548 


0 


0 




r 0.0470 -1 


z 2 (z - 0.9217) 




z(z- 0.9217) 


0.4882 


0.0808 


0 


; G d (z) = 


0.5077 


CN 

05 

CD 

1 


z - 0.8607 


z - 0.9024 


0.0348 


0.3564 


0.2298 




2.7858 


L « - 0.8607 


z - 0.9024 


z- 0.8607 J 




L z - 0.8607 J 



3. Minimal (physical) realisation 

To get a realisation we can basically follow two different approaches: 

i) To analyse the system’s structure and detect row (column) common modes 
to be attached to the same output (input) variable. 

ii) To get a partial realisation of each element, add altogether and reduced 
afterwards. 

We will follow the first approach, to keep an eye on the physical meaning of the 
variables. In this way, the block-diagram depicted in Figure 3.5 is obtained. 
We have considered a common pole at (z — 0.8607) attached to output y 3 , as 
well as a delay on input U\ dealing with y 3 and y 2 . 

From this diagram, Figure 3.5, a state variable may be assigned to each 
first-order block, leading to a seventh-order model. Using the notation Xk = 
x(k), it yields : 

x(k) = [xi(fc) X2 (fc) X3 (fc) X4 (fc) X5 (fc) xq (fc) x 7 (fc)] T 

The full model, including the disturbance, can be expressed by the following 
state equations: 

’ xi (k) = ui(k — 1) 

X 2 (k) = xi(k — 1) + 0.8571dp(fc — 1) 
x 3 (k) = 0.0548x2 (k - 1) + 0.9217x3 (k - 1) 

< x 4 (k) = 0.4882x1 (k - 1) + 0.9024x 4 (fc - 1) + 1.0400d F (fc - 1) 
x s (k) = 0.8607 x 5 (fc - 1) + 0.0348m (k - 1) + 0.2298 u 3 (k - 1) + 2.7858 D F (k - 1) 
x 6 (k) = 0.8607x6 (k - 1) + 0.0808m (fc - 1) 

_ x 7 {k) = 0.9024 x 7 (k - 1) + 0.3564u 2 (fe - 1) 

the output equations being: 

( yi{k) = x 3 (k) 

1/2 (k) = x 4 {k) + xe{k) 
y 3 {k) = xs(k) + x 7 (k) 
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fdt4 



Figure 3.5. Approximate DT model 



The disturbed model, is Xk+i = Axk + Buk + FcIf, yu = Cxk , with: 

0 0 0 0 0 0 0 " 

1 0 0 0 0 0 0 

0 0.0548 0.9217 0 0 0 0 

; A = 0.4882 0 0 0.9024 0 0 0 

0 0 0 0 0.8607 0 0 

0 0 0 0 0 0.8607 0 

0 0 0 0 0 0 0.9024_ 

1 0 0 1 [ 0 

0 0 0 0.8571 

0 0 0 0 [001000 0" 

B = 0 0 0 ; F = 1.0400 ; C = 0 0 0 1 0 1 0 

0.0348 0 0.2298 2.7858 |_ 0 0 0 0 1 0 1 

0 0.0808 0 0 

0 0.3564 0 J [ 0 

4- Open-loop model validation 

In order to check the model approximation, the step response of the “real” 
plant, that is, the model G(s), and the DT approximate model are compared. 
In Figure 3.6, the output responses to a simultaneous unit step change in the 
three inputs are plotted for both systems, assuming no disturbances. Although 
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the ZOH discretisation preserves the step response, the small acceptable dif- 
ferences shown in the plots are due to the assumed approximations in the 
model parameters. 






Figure 3.6. Step response of the CT and the approximate DT column model 



b) Structural analysis. Mainly as a matter of training and analysis, we can 
study the reachability and observability conditions for the Ed model. As an 
example, let us consider the following options: 

1. Determine the lower number of concentration sensors and their placement 
to detect the three controlled variables. 

If we compute the observability matrix rank for each of the output vector 
components, that is, the observability of the pairs (A, * C), we will realise 
that no output can observe the full state, and thus, we need more than one 
output to observe the three controlled variables. In fact, this can be easily 
deduced by just looking at the block-diagram in Figure 3.5, concluding 
that we need three sensors. 

2. To counteract a disturbance, Z\dp (unitary step), compute the control 
sequence (extraction flows) to get back to the initial conditions: 

i) In the shortest time. 

ii) With the lower variation in the control flows, and a sequence of n 
(system order) actions. 

Let us discuss in some detail these two disturbance-rejection alternatives. 
i ) For the first requirement, the reachability index should be computed: 
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Build up the reachability matrix of the pair ( A , B): 

Co = [B AB A 2 B A 3 B A 4 B A 5 B A e B] 

= [b 1 b 2 b 3 Ab\ Ab 2 Ab 3 A 2 b i • • • A 6 b 1 A 6 b 2 A 6 b 3 ] 

with mxn = 3x7 = 21 columns. 

As its rank is 7, let us form a partial matrix taken the first 7-independent 
columns: 

Coi = [h b 2 b 3 Ab x Ab 2 A 2 b x A 3 b x ] 

which yields the following conclusions: 

• iq-reachability index: /.q = 3, 

• rq-reachability index: /j, 2 = 2, 

• it 3 -reachability index: fi 3 = 1, 

• system reachability index: fiQo = max (/x i, fi 2 , /x 3 ) = 3. 

Thus, the state reachability time is 4, and the control actions to be applied 
are: 

UTmin = [«i(3) u 2 ( 3) m 3 (3) «i(2) u 2 { 2) txi(l) wi(0)] T 

Assuming an initial state Xq at the time the step disturbance is applied, 
the control sequence to drive the state to the equilibrium (origin) will be 
computed by 12 : 





/ 


cIf{3) 


\ 


Coi 1 


x(4) - A 4 x(0) - [F AF A 2 F A 3 F] 


c?f(2) 

^f(I) 






{ 


^f( 0) 


/ 



In particular, if ( dp(k ) = 1), and (a:(0) = x{A) = 0), the control will be: 



UTmin = -Coi 1 [ F AF A2p 



1 

1 

1 

1 



the control effort being: 



0 




ui (3) 


0 




u 2 (3) 


—37.1775 




u 3 (3) 


- 0.8571 


= 


«i(2) 


0 




u 2 (2) 


- 232.0935 




iq(l) 


249.2297 




ui(0)_ 



3 3 

E Tmin — EE (iti(fc)) 2 = 1.17365 x 10 5 

fc = 0 i = 1 

12 Equation (3.41) must be suitably modified by moving the effect of disturbances 
(non-manipulated inputs) to the right-hand side. 
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ii) Minimum control effort (in n = 7 intervals) 
In this case, the system evolution is given by: 





u{ 6) 






d F (6) 


x{7) = A 7 x{ 0) + [ B AB ■ ■ ■ A 6 B] 


u(l) 


+ [ F AF ■ ■ 


■ A 6 F] 


d_ f(1) 




_«(0)_ 






_dp(0)_ 



The pseudoinverse {Co') provides the minimum norm solution for the 
control sequence. Thus, for a;(0) = 0: 





/ 


'1' 


\ 


U Emin — Co 


x{7) - A 7 x{ 0) — [ F AF ■ ■ ■ A 6 F] 








V 


1 


/ 



U 



Emin 



Ui(0) U 2 (0) u 3 { 0) 




Ui(l) u 2 { 1) u 3 { 1) 




ui(2) m 2 (2) u 3 { 2) 




ui(3) u 2 (3) u 3 { 3) 


= 


ui(4) u 2 (4) m 3 (4) 




ui( 5) u 2 (5) m 3 (5) 




_ui(6) u 2 (6) u 3 (6)_ 





82.6985 0 -6.4345 
51.5983 0 -7.4758 
13.7274 0 -8.6857 

- 31.9367 0 -10.0913 
-86.5520 0 -11.7244 

- 0.8571 0 -13.6218 

0 0 -15.8263 



the control effort (much lower than before) being: 



6 3 

C Emin EE (ui(k)f = 1.9049 x 10 4 

k—0 i = 1 



Note that the second input is not used at all. 



Gains. It is clear that the instantaneous gain is null and the static gain is 
given by 



G = 



0.7 0 0 

5 0.58 0 
0.25 3.65 1.65 
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Solutions to the Control Problem 



This chapter deals with a description of the solutions to the control problem 
available to the designer. Most of these possibilities will be detailed in subse- 
quent chapters, but the objective of the chapter is to outline the context and 
the practical possibilities. 



4.1 The Control Design Problem 

A basic and obvious idea, key conclusion from the previous chapter, should 
be clarified from the beginning, if a control system is designed to control a 
given process: 

The process should he capable of behaving in the required way. The 
best control subsystem will just provide the most suitable inputs to the 
process to fulfill the goals. 

This has two main consequences: 

1. If capabilities required to meet some goals are not built into the process, 
the control cannot achieve them. 

2. The control system is “selecting” the best input, among the possible ones, 
to fulfill the goals. 

Based on this evidence, there is a tendency nowadays to integrate the design 
of the process and its control. 

For instance, in designing the control of a multiple-stage reactor process, 
the integral design of the control of the whole system, as well as forcing the 
interaction among stages, may reduce the control effort and achieve much 
better performances. A good example of this can be seen in [116]. 

Usually, a control system should be designed to work together with an 
already existing process. The control design problem can be stated at local, 
supervisory or even plant-wide level. Some ideas about the higher levels will 
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be discussed in the last chapter. If we consider the local level, the usual steps 
in designing the control are: 

1. Define which are the components of the process to be controlled, which 
equipment parts are manipulable and which are fixed. Also define which 
are the variables of interest. 

2. Define the user control goals. 

3. Get a draft model of the process and the attached signals. 

4. Select which will be the manipulated and measured variables. 

5. Choose a suitable control structure. 

6. Translate into a control language (also appropriate for the selected control 
structure) the user requirements. 

7. Apply the controller design methodology based on the decisions taken in 
the previous steps (variables, models, goals). 

8. Validate (by simulation or experimentally) the design, and tune the con- 
troller parameters. 

9. Define the controller implementation. In the case of digital controllers, 
select the hardware and software to fulfill the control requirements. 

10. Install the control in the process. 

11. Evaluate the controlled system performances. 

Most of these activities should be done iteratively. For instance, if the designed 
controller does not match the requirements, either the control structure or the 
variables selection should be revisited. If the implementation of the controller 
introduces additional constraints (time delays, computation time, resources 
availability, etc.), the design should be reconsidered, taking into account the 
new requirements. If the controlled system is driven out of the region of valid- 
ity of the model, a new model should be obtained or the uncertainties should 
be reduced. 

In the previous chapters, the modelling and analysis issues have been de- 
tailed. This can be done with a rough idea about the control goals. Neverthe- 
less, once the user control goals have been stated, some decisions should be 
made to design the controller. 

• which variables are selected as controlled, measured and manipulated and 
which ones are going to be treated as disturbances? 

• based on this selection, which are the achievable performances? 

• to meet the control requirements, which is the most suitable control design 
approach? 



4.2 Control Goals 

From a set of usually ambiguous “user” control goals, mainly based on quali- 
tative and economical requirements as well as operational constraints, the de- 
sirable controlled plant performances for “control design” should be derived. 
They may concern different properties, such as: 
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• reference tracking, to follow changes in the set-points or references, 

• control decoupling, to better understand and tune the different subpro- 
cesses or control variables, 

• disturbance rejection, to cope with non-manipulated external variables, 

• measurement noise rejection, to be able to use “imperfect” sensor and 
transmission systems, 

• robustness against changes in the plant (model) or expected disturbances. 

Some of these goals may be contradictory so this is a multi-criteria decision 
problem. A suitable trade-off is the most we can achieve. 

Tracking performance. The classical performance measures in reference 
tracking, such as overshoot, settling time, bandwidth, cut-off frequency or 
resonance peaks, among many others (see the classical books of Franklin [49], 
Kuo [78], etc.), should be taken with caution in MIMO systems. The main con- 
cern is the gain directionality . An adequate response of a controlled variable if 
two inputs are acting sequentially can become unacceptable (for instance, ex- 
hibiting significant inverse response) if both are applied simultaneously. This 
is the effect of the process interactions. 

Also, the usual conclusions given by the pole location, the basis of the 
pole assignment control design technique, should be treated carefully because, 
as we have seen, the system poles and zeros are not the poles of a given 
input/output relationship. 

Control decoupling. The previous concerns ask for some kind of decoupling 
if generalisations of SISO criteria are to be applied. If the process is rearranged 
in such a way that each input (or block of inputs) only influences one output, 
the controlled process structure is simplified and it can be analysed as com- 
posed by m subprocesses. This is the main advantage, as the controllers can 
be designed and tuned independently. We will see in the next chapter some 
techniques to achieve this decoupling. 

But the interactions are natural in many processes and they can work in 
the right way to control the process. In a general case, it seems wasteful to use 
some control effort in decoupling the process and then requiring an additional 
effort to control the subprocesses if it is in the opposite direction. 

Diagonal dominance was a concept introduced for gain matrices, but it 
can also be extended to transfer matrices. In this case, the dominance can be 
established from different points of view. Other than the gain (in steady-state 
or at a critical frequency), it is interesting to consider the delays and/or the 
controllability of each output /input pair, as analysed in the next section. 

Triangularity of transfer matrices is also a convenient property allowing the 
design of the controllers in sequence, considering the former ones as generators 
of disturbances for the later ones. 

Disturbance rejection. We should consider two different types of distur- 
bances: 
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Process disturbances are those modifying the internal process variables. 
These should be counteracted by modifying the manipulated control inputs. 
Thus, it would be convenient to know them in advance (in some cases, the 
reference can be considered as such a disturbance, being known by the user). 
Otherwise, we will be interested in measuring them or, at least, in estimating 
their current value. This will allow us to generate the extra control signals. 
Input disturbances are a particular case, acting at the process input. They are 
the easiest to be cancelled once their value has been measured or estimated. 

Measurement noise is a disturbance which only has effect on the process if 
it is fed back by a controller. Thus, in this case, the best option is to filter it 
to avoid it acting as a disturbing input to the controlled process. Inferential 
control (Section 5.5.1) is a modern control technique generating the control 
action from estimated “noise- free” measurements. Of course, they cannot cope 
with the other kind of disturbances or model uncertainty. 

Robustness. Model uncertainty has been the big issue in modern control 
design techniques. A good model-based control system could become useless 
if the plant behaviour strongly differs from that of the model. Thus, model 
uncertainty should be assessed and the designed loop should behave appro- 
priately, taking into account the uncertainty when designing the controller. 

Again, in the MIMO systems, interactions should be taken into account. 
A control loop may be robust to uncertainties in the elements of different 
subprocesses, if they appear separately, but drastically losing its properties 
if the uncertainties appear simultaneously in different parts of the process. 
Robust control issues will be the subject of a later chapter. 



4.3 Variables Selection 

In developing a model of a process, we may consider a very large number of 
external and internal variables, all of them related to the partial phenomena 
we are interested in: hydraulic, thermal, concentration, movement, energy and 
so on. But, certainly, we do not need to control all of these and we do not 
need either to measure or to manipulate every one. That means, a selection 
of variables should be done. 

Three selections must be carried out: 

• selection of controlled variables, 

• selection of measurements, 

• selection of manipulated variables. 

System analysis knowledge may help in some cases to take decisions based 
on a full-size model. However, its usefulness is limited, and these selections 
should be also guided by experience and common sense. 




4.3 Variables Selection 



103 



Controlled variables. Ideally, the controlled variables must verify the fol- 
lowing requirements: 

1. They must relate to the primary user goals. 

2. Primary goals should not be excessively dependent on small deviations of 
them (otherwise, small controller errors will unacceptably degrade overall 
objectives) . 

3. Its optimal set-point must not depend on the value of exogenous dis- 
turbances (to avoid designing a “good” controller following a “wrong” 
set-point). 

4. Disturbances must cause small deviations on them (so low control “inten- 
sity” is needed). 

5. Process state and input/output controllability are sufficient to actually 
design satisfactory controllers for them. 

Some of the ideas in Section 5.5.1 are based on the above issues. If a set of 
variables fulfilling these requirements cannot be found, the process is “difficult 
to control” and redesign may be the wisest choice. 

Example 4-1- [119] In an oven, setting the heating power as controlled variable 
(manipulating the supply voltage) is not a wise choice, as its optimal set-point is 
heavily dependent on factors such as heat loss, oven size, etc., whereas the oven 
temperature is a much better choice. 

State Representation 

Let us assume a state space description of the plant to be controlled. As we 
have seen in the last chapter, some internal variables may be deleted by reduc- 
ing the model order. The order may have been reduced to achieve a minimal 
realisation and to eliminate the state variables with reduced relevance into 
the (input)-to-(controlled variables) dynamics. In the following, it is assumed 
that fundamental control objectives may be approximately cast as objectives 
on the state variables. 

Measurements. Note that controlled variables and measured variables are 
not the same thing. The issue now is to consider which of the available sensors 
(combinations of state variables) should be used. 

This requires an analysis of the output equation, (2.11) or (2.19). Of course, 
the pair (A, C) should be observable. The best would be to measure all of the 
state (C = /), but this can be unfeasible (there is no sensing device for some 
variables or they are not reachable) or too costly. From this viewpoint, the 
best sensing option would be the set of outputs so that the degree of observ- 
ability is maximum. This means minimum observation time and maximum 
detectability. This will come out from an analysis of the observability matrix. 
The measurement conditions and, as a result, the measurement noise, could 
be an issue to include or delete a given sensor. For the above results to be 
significant, matrix C should be scaled so that all sensors have comparable 
noise amplitude. 
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Actuators. For simplicity and economical reasons, the number of manipu- 
lated variables should be as low as possible. This requires us to analyse the 
state equation and, particularly, the reachability of the pair (A, B). Again, 
the maximum degree of reachability would be required, with the minimum 
number of control inputs. But, in this case, we must keep in mind that these 
control inputs should be also able to counteract the rest of external variables, 
that is, the disturbances. Thus, the generalised state model (2.21) should be 
taken into account. 



Input/output properties 



As a further consideration, not all the states could be equally relevant in 
our control goal. Thus, other than the input-state-output relationship, the 
direct input/output relation should be considered. Based on the analysis of 
the transfer matrix, we can deduce the more or less close connection of the 
outputs to the inputs. And we must consider two issues: time and gain. 

Desirable input/output relationships must have simple dynamics. A con- 
trol action (or a measurement) will be less interesting as far as the delay it 
introduces increases. For that purpose, let us define the output reachability- 
time matrix 



( 7*1 1 7*12 • • • ri m \ 
7*21 7*22 * * * r 2m 

V’pi r P 2 ■■■ T* pm ) 



iC *A r * Bj 



^0 
= 0 



r = nj + 1 
t * < r.ij 



(4.1) 



This matrix represents the input/output distance, in time. It is also denoted 
as the relative degree matrix, because its elements are the relative degree of 
the transfer function elements of the transfer matrix. 

In order to consider the magnitude, other than the static and instantaneous 
gains, the characteristic matrix defined by: 



J = 



/ 7n 712 * 
721 722 * 


* 7lm \ 

• 72m 


\7pi 7 P 2 * 


* 7 pm ) 



7 « =i c * • 1 * Bj 



(4.2) 



represents the first action for each input/output pair. These ideas are helpful 
mainly in decentralised control and decoupling (Section 5.3). 

Feedforward disturbance rejection. As previously mentioned, distur- 
bance variables are also candidates to be measured, if possible, to allow the 
fast generation of the counteracting control actions. 
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Transfer Matrix: Extreme Gains and Variables Relevance 

The I/O indicators just presented (characteristic and relative order matri- 
ces) only provide partial information, related to high-frequency behaviour. To 
decide about the selection of variables, the frequency-dependent directional 
gains give interesting and complementary information. Again, these gains are 
sensitive to scaling. The variables should be normalised, according to scaling 
remarks in Section 3.5, to get comparable and relevant information. 

Recall that the SVD of a matrix, Section 3.5.3, provides the maximum, 
(a), and minimum, (a ) , gains, and its ratio (the condition number, (3.36), 
7 = ct/ct). From the frequency response matrix of a process, these gains may 
be computed as a function of the frequency. 

Let us assume a process with over-dimensioned input and output vectors 
so that a selection of a subset of them must be carried out. 

Actuators. First, let us consider the transfer matrix in z = G z u, where z 
are p z controlled variables and u is a candidate actuator set. Carrying out the 
SVD, G z = USV H , the first p z columns of matrix V are the combinations of 
manipulations with highest effect on the control objectives, so if a particular 
actuator Uk has no significant components Vik on them, it may be discarded. 
Note that as V may be frequency-dependent, there exists the possibility of 
needing one set of actuators for control in one frequency range and a different 
set for a different frequency range. That possibility is, indeed, not unusual in 
practice, as cascade control examples in Section 5.4.2 point out. 

Measurements. In sensor selection, the key issue is how measurement noise 
and disturbances corrupt a, perhaps indirect, measurement of the controlled 
variables. A detailed treatment of some of the issues involved appears in Sec- 
tion 5.5.1. Assuming all sensors have been scaled so that measurement noise 
is similar, as y = Gu = GG~ x z, the SVD decomposition of GG" 1 = UEV H , 
will point out which sensors (G over-dimensioned) better “measure” the con- 
trolled variables: those will be the first columns of U. Note that this is a coarse 
criterion as the effect of process disturbances is not accounted for (for further 
details, see Section 5.5.1). The frequency-dependent nature of U may advise 
different sensors for different frequency ranges. Again, this is usual in practice, 
and it is behind some cascade-control strategies as well (Section 5.4.1). 

Of course, the more sensors and actuators the better, but the more ex- 
pensive the instrumentation is. A comparison with the magnitude of the un- 
avoidable noise in the process will also indicate the uselessness of variables 
attached to lower singular values (low-gain actuators or sensors). 

In many cases, it is wished that controlled variables and measured ones are 
the same. So, the issue is selecting a “good” subset of p inputs and outputs 
on the “big” G so that the “underlying” process is under control. This has 
close resemblance with the state space analysis previously discussed. 
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Conditioning. Apart from the issues of “gain” just discussed, sensitivity to 
uncertainty is also an issue: conditioning should be reasonable if high perfor- 
mance needs to be achieved. So, if the SVD is carried out for subsets of inputs 
and outputs, the selection of variables can be based on getting the minimum 
condition number (closer to 1), indicating a similar behaviour, and hence, dif- 
ficulty to control, in any direction. And this can be done for static gains as 
well as for gains at some critical frequencies. 

Based on the SVD techniques, the following guidelines can help in deter- 
mining a good selection of variables: 

• given a process with mo possible manipulated variables and po measurable 
internal variables, carry out SVD of the gain matrix (it could be the static 
gain or that at a critical frequency) after a suitable scaling, 

• determine the condition number, 70, and the lowest singular value, a 0 . A 
high value for 70 indicates poor conditioning, and a low value of <r 0 points 
out poor action in some directions, 

• analyse the columns of U (V) and assign each one of them to the most 
weighted output (input) vector component. Any key output (input) com- 
ponent should be in this group, 

• to compare different sets of input/output choices, 7 (the lower the better) 
and a (the higher the better) can be assessed. 

This decomposition can be also used for system decoupling, as detailed in the 
next chapter. However, in a general system, there may be many (hundreds) of 
I/O combinations to check. Another useful variable selection tool, the relative 
gain array (RGA), is based on the interactions among variables and will be 
detailed in the next chapter. It can be used for a global preliminary screening, 
avoiding most of the unsuitable combinations [ 119 ]. 

Apart from the above considerations, the presence of RHP zeros, delays, 
etc. should be taken into account. Of course, the cost of the sensor/actuator 
alternative is an important factor. A wrong variable selection will limit the 
achievable performance and robustness of the final control scheme. 



4.4 Control Structures 

The selection of the variables to be used as control variables as well as the 
information used to generate the control actions will determine the control 
system structure. We must consider, at least, the following structures: 

Open loop vs. closed loop. In an open-loop control structure, the control 
actions are generated based on external information: set-points or objectives, 
initial conditions, disturbances, operator data, and so on. A good model of the 
process is required and there is no option to cope with unexpected changes in 
the plant (either disturbances or plant changes). On the other hand, closed- 
loop control uses the information from the plant to generate the control. There 
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are many options for dealing with disturbances, reference tracking and uncer- 
tainties, but the big issue is the controlled plant stability (and performances). 
One obvious drawback of closed-loop control is the requirement of the exis- 
tence of errors to act. Thus, a combination of both structures may allow better 
results. 

Single/multiple loop. In feedback controlled MIMO systems, the vector of 
input actions may be computed altogether from the full set of measurements 
and available data or, alternatively, the information is split into blocks to de- 
termine each of the control actions. In this case, for each input, the remaining 
blocks of information can be considered as disturbances. This structure could 
be also denoted as centralised/decentralised control. 

Two degree of freedom. The control action may be computed in two 
phases. First, the control error is evaluated and the control is based on the er- 
ror. This is a feedback control action. Afterwards, an additional control action 
is computed based on the external inputs. There are two degrees of freedom 
to design the controller, and the design can be split to achieve tracking (ref- 
erences) and regulation (output feedback) performances. 

Multi-level control. Groups of input (output) variables can be treated 
jointly to control a process variable. They will act locally, receiving com- 
mands (set-points) from higher decision levels and sending information back 
to these upper coordination levels. 



4.5 Feedback Control 

As previously mentioned, the main problem in closed-loop control is to design 
the elements of the controller to achieve the required closed-loop performances 
and, in any case, to assure the stability of the controlled plant. 

In order to analyse the fulfillment of these properties, the relationship 
between different variables should be taken into account. For this purpose, 
with reference to Figure 1.3 on page 10 (assuming, for simplicity, F = I), the 
output of the controlled plant, under negative feedback, can be expressed by: 

y = G(s) (' u + d u ) + G d (s ) d 
u = K(s) e 
e = r — H(s) ( y + n) 



where Ud is an input disturbance vector, K is the controller transfer matrix, n 
is a measurement noise and H is the measurement device dynamics, the mea- 
surement noise filter or the feedback controller (in a 2-DoF control structure 
with F ^ I, Section 4.7). Carrying out suitable matrix operations, the output 
vector can be expressed by: 




108 



4 Solutions to the Control Problem 



y=(I + GKH)~ 1 (GKr + Gd u + G d d - GKHn) 
or, equivalently, by suitable definitions of M, T and S (see below): 

y = Mr + SGd u + SG d d + Tn (4-3) 

The control action is: 

u = (I + KHG)~\Kr - KHGd u - KHG d d - KHn) 

so, applying the push-through rule (B.5): 

u = (I+ KHG)- x Kr - KHS(Gd u + G d d + n) (4.4) 

Thus, the following matrices are relevant: 

1. Loop transfer matrix: L = GKH , which determines the loop stability if 
there are no pole-zero cancellations in the three factors (see next section) . 

2. Sensitivity matrix 

S = (I + L)- 1 = (I + GKH)- 1 (4.5) 

which defines the effect of the feedback on the general disturbances, d. 

3. Complementary sensitivity matrix 

T = (I + GKH)~ 1 GKH (4.6) 

defining the effect of the feedback in the noise rejection. It is denoted as 
complementary sensitivity because, from (2.55): 

As) + S(s) = I (4.7) 

4. Reference tracking matrix: M = (/ + GKH)~ 1 GK , allowing to analyse 
the output/reference properties. 

5. Input-gain matrix: KHS, expressing the effect of disturbances and mea- 
surement noise on the control action. 

In the following, H = 1 is assumed, the matrices above being simplified to: 

L = GK ; 5 = (I + GK)- 1 - T = M = (I + GK)~ X GK S + T=I( 4.8) 

4.5.1 Closed-loop Stability Analysis 

Internal stability. From (4.3) and (4.4), the stability of the closed-loop 
system requires that the four transfer matrices: S, SG, KS and KSG have 
no RHP poles 1 (assuming, of course, no unstable uncontrollable/unobservable 
modes in K or G). In that way, y and u are bounded for bounded d, d u , n, r. 
If this property holds, the loop is said to be internally stable. 

1 Note that G d is stable (from the assumption of bounded disturbances) and, as 
S + T = 1, T is stable if and only if S is stable. Furthermore, regarding the 
reference term in (4.4), from (B.5), (/ + KG)~ 1 K = KS. 
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State space representation. Assume a plant G := (.4. B, G) without in- 
put/output direct coupling, D = 0, in feedback connection with a controller 
K := (A c , B c ,C c , D c ). The closed-loop system model is given by (2.51). So, 
its stability will be determined by the poles of the closed loop system matrix 

A = ( A-BD c C BC c \ 

\ B c C A c J 

Alternatively, the open-loop L is the series connection GK , with a state 
space representation (Al, Bl,Cl, Dl = 0) given by (2.47). Connecting by 
negative feedback, it is easy to show that: 

A = A l - B l Cl 



To calculate the eigenvalues, using Schur’s formula (B.4) twice, we can 
express: 

Aet(sl — A l+ B lC l) = det ^ ^ S f-A L ) = det(sI-A L ) det(I+C L (sI-A L y 1 B) 
Thus, the following interesting property is derived: 



det (si — A) 
det (si — Al) 



det(I + L(s)) 



(4.9) 



So, if there are no common poles in open and closed loop, the closed-loop 
poles are determined by the solution of 



det(I + L(s)) = 0 

I + L(s) is denoted as the return difference operator: it must have no RHP 
zeros for loop stability. 

RHP cancellations. It can be shown, based on the above results, that the 
closed loop is internally stable if and only if there are no RHP pole-zero 
cancellations between G and K and S = (/ + T(s))” 1 is stable. In this way, 
only one closed-loop transfer matrix must be checked, instead of four. 



Frequency Domain 

Nyquist criterion. In control, frequency domain techniques are mainly valu- 
able because they allow us to determine closed-loop stability properties based 
on the analysis of the open-loop frequency response. The stability of a MIMO 
system can be analysed by the Nyquist plot of det (/ + L(jw)). In a simple 
way, we can say that if L(s) is stable, the closed-loop system is stable if the 
Nyquist plot of det(/ + L(s)) does not encircle the origin. To use the same 
analysis as in SISO systems, we may plot the scalar function 

l*(jw) = det (I + L{jw)) — 1 
and check for encirclements of the point (—1,0). 
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The small-gain theorem. An intuitive result, quite useful in frequency 
domain stability analysis, is the small-gain theorem. If L(s) is stable, the 
closed loop system is stable if 

\\L(jw)\\<l \/w 

For linear systems, the result is easily obtained from the Nyquist criterion. It 
is very conservative but it can be used to ensure the stability of some special 
closed-loop configurations (see Chapter 8). A detailed discussion is available 
in Appendix C.4. 

High-gain control. Note that for those frequencies with very high gain in 
the direct path, \G(jw)K(jw)\ 1, the sensitivity, (4.5), vanishes and the 
complementary sensitivity, (4.6), reaches unity, being M(s) ss Ft _1 (s). This 
implies, from (1.6): 

• process model uncertainties are not so relevant with high-gain feedback 
control (G(s) “disappears”), 

• the reference tracking matrix is the inverse of the sensing matrix. That, is, 
it emphasises the relevance of the data acquisition system: without quality 
sensors good control is not possible, 

• measurement noise fully affects output, 

• the effect of the disturbances also vanishes. 

So, it seems that lrigh-gain controllers are a viable solution with good sensors 
available. However, apart from obvious saturation issues, the above argument 
is not totally right, and high gain is not a viable solution in most applications. 
In Section 8.2.2, the issue is discussed in more detail. 

Remark 4-2. A rule of thumb dealing with SISO closed- loop systems is that 
the stability is degraded if the loop gain is increased or additional delay is 
introduced in the loop. This is true for almost any system, except for those 
called conditionally stable systems, which are only stable for a range of gain or 
phase lag 2 . Caution should be taken with these concepts in MIMO systems. 



4.5.2 Interactions 

Assume a SISO system with a well-designed closed-loop control, u\-y\, having 
other inputs and measured variables but not yet used for control. Now, another 
input is generated (by a second controller, 142 -J/ 2 ) to control one extra output, 
closing a second loop and forming a TITO system. If performance of the first 
loop remained unchanged, i. e., if closing the second loop did not affect the 
input/output behaviour of the initial control pair, then there would be no 
interaction between these loops. 

Unfortunately, this is not the usual case because the transfer matrix is not 
diagonal. If some variables of a process are independently controlled there is 

These are the so-called gain and phase conditionally stable systems, see [6]. 
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an interaction among the different loops and the performances may be severely 
degraded. 

Let us consider the simple case in a TITO feedback loop such as the one 
in Figure 1.3 on page 10 where the feedback controller is a diagonal one. If 
the diagonal elements, K\ and K 2 , are designed such that 

_ GuKi __ G 22 I\ 2 

1 ^ 1 + Gi 1 K 1 ’ 2 1 + G 22 K 2 

meet some requirements, the actual behaviour will be determined by: 

T = [I + GK]~ 1 GK; I< = diag[R\ K 2 ] 

In particular, the stability would be defined by the roots of: 

det(/ + GA) = (1 + GnAi)(l + G 22 K 2 ) ~ G\ 2 G 2 \K^K 2 

It is clear that, only in the case G12 = 0 or G 2 i = 0 (triangular plant), this 
condition is reduced to det(I + GK ) = (1 + GnA'i) (1 + 622^2) and the global 
stability is as designed for the single loops. In Section 5.2, this issue is further 
discussed. 

4.5.3 Generalised Plant 

In the 1980s, a general solution [44, 133] for a wide variety of control problems 
was found via the linear fractional transformation formalism, by formulating 
them in the generalised interconnection form in Section 2.7.2. 

To achieve this, a controller can be connected to the plant via a set of 
sensed variables (either outputs or direct measuring of some of the distur- 
bances) so that a transfer matrix K calculates a set of manipulated inputs to 
the process. Figure 4.1 depicts the idea in block-diagram form, where the ac- 
tual plant and the control structure (information flow) and control objectives 
conform the generalised plant, P. 



Disturban ces, 
set-point commands 

Manipulated variables 
(actuators) i — ► 




Deviations in controlled 
►variables, actuators 

Available measurements 
(output and disturbance sensors, 
I set-point commands) 



( Control 
i System j 



Figure 4.1. A general configuration of a control loop 



If some of the regulator inputs are measurable disturbances or user-defined 
set-points, then the direct input /output coupling D\ 2 of the generalised plant 
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is non-zero. This block-diagram is named in the literature as a lower linear 
fractional transformation. Note the similarity with Figure 1.2. 

Some examples will help in grasping the ideas involved in the procedure of 
generating the generalised plant. Sections 7.4 and 8.6.1 detail some approaches 
to solving the control synthesis problem in this framework. 

Example 4-3 ( Open-loop control). The block-diagram in Figure 4.2 shows a MIMO 
open-loop reference tracking problem cast into the general configuration. From the 
figure, it is clear that the generalised plant has a transfer function matrix given by: 



/ errors \ _ f I —G \ / r \ 
controller input J \ I 0 J \u ) 



(4.10) 




Figure 4.2. Open-loop control 



Example 4-4 (Disturbance rejection: closed-loop control). The block-diagram in 
Figure 4.3 shows a MIMO disturbance-rejection problem with sensors measuring the 
disturbed output. The generalised plant has a transfer function matrix given by: 



/ errors \ _ (I G\ / cA 
y controller input J \I G ) \u ) 



(4.11) 




Figure 4.3. Closed-loop disturbance rejection. 
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4.5.4 Performance Analysis 

There are several criteria for defining “good nominal performance” in terms of 
the closed-loop transfer matrices defined in this section, to be discussed below. 
In addition to that, tolerance of the solution to modelling errors should be 
assessed (see Chapter 8). 

Settling time. It is a direct generalisation of the concept of SISO systems. 
In MIMO plants, the settling time for different input /output pairs may be 
different. It is related to the position of the system poles (see Appendix A) 
and its internal structure (controllability and observability). 

Overshoot. This common SISO requirement is cumbersome when gener- 
alised to MIMO systems, as interactions cause deviations in all variables when 
subject to set-point changes or disturbances. Although it can be checked for 
particular input/output combinations, it is not usually used during the design 
phase, in favour of more tractable integral-squared-error criteria (Chapter 7). 

Steady-state gain. Position errors for reference tracking are determined, in 
most loops, by the DC gain of the sensitivity function (4.5). For disturbance 
rejection, the steady-state gain of SGd in (4.3) may be determined. To sum- 
marise all combinations, if the worst-case gain a(S) (or a (SGd)) is below a 
suitable bound, steady-state performance conditions are deemed satisfactory. 

Bandwidth. Many control requirements can be cast in the frequency do- 
main, in particular, ability to track references varying up to a maximum rate 
and ability to reject disturbances whose frequency components are mainly 
concentrated on a particular band. In particular, the effective control band 
is defined as the frequency band where the worst-case sensitivity < f(S ) is be- 
low —6 dB, indicating a minimum attenuation of 50% of output disturbances 
or tracking with stationary error less than 50% (see Example 3.5). In many 
cases, good performance is required at zero frequency (DC position error), so 
reduced sensitivity is achieved from zero to a particular frequency ujb'- the 
closed-loop bandwidth is defined as the frequency where a(S) crosses —6 dB. 

For disturbance rejection, comparison of the worst-case open-loop re- 
sponse, ?j(Gd), and the closed-loop one, a(SGd), will determine how effective 
control design has been 3 . Figure 7.4 on page 217 depicts such a situation in 
the context of a distillation case study. 

Optimality. As previously commented, the different possibilities on allowed 
amplitude of actuator commands, allowable errors, amplitude of disturbances 
and set-points to be tracked, etc. pose a difficult problem if all of these require- 
ments must be individually accounted for in the design process. However, they 

3 With a suitable scaling of the variables involved, approximate determination of 
satisfactory performance can be conveniently assessed by comparing a particular 
worst-case gain with 1. Details will be given in Section 8.6.1, after introducing 
many additional concepts needed. 
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may be approximately expressed as a cost index (sum of squares) so that opti- 
misation can be carried out. Optimisation-based control is a powerful strategy 
with significant impact in practice. Chapter 7 is fully devoted to this issue. 



4.6 Feedforward Control 

Feedback control can compensate for disturbances and modelling errors if 
suitably designed. Furthermore, by interpreting the set-point changes as dis- 
turbances (see Section 6.1.2), with a suitable higlr-gain feedback, satisfactory 
reference tracking can be also achieved. In fact, the feedback-only solution is 
widely used in most control applications. 

However, there might be circumstances where: 

• the most significant disturbances are measurable, and 

• non-measurable disturbances are small, and 

• the plant is stable and a reasonably accurate model is available (perhaps 
even non-linear), and 

• high performance is desired in either reference tracking or measurable dis- 
turbance rejection (or both), 

• a particular key sensor (or group of them) is unavailable but a model to 
compute this variable is available. 

In these circumstances, feedforward control can be a valid solution. In fact, 
the addition of feedforward strategies (see Section 4.7) in a closed-loop control 
is key to ensuring high-performance reference tracking as well as sufficient 
robustness to modelling errors (see Section 8.4.3). 

Example 4-5- In process industry, pH control can have a strongly non-linear char- 
acteristic under common circumstances, due to the logarithmic nature of the mea- 
surement and valve non-linearities. Handling the problem by pure (linear) feedback 
control meets with many difficulties. In many cases in practice, the only way to 
achieve satisfactory disturbance rejection (with a reasonable buffer tank size, where 
the acid + base mixing is carried out) is to implement non-linear feedforward strate- 
gies based on measurements of the incoming flow and pH, perhaps as a part of a 
more complex structure incorporating feedback, such as gradual control (Section 
5.5.4) and cascade control (Section 5.4). 

4.6.1 Manual Control 

The most elementary control problem is how to place the actuators to achieve 
a particular desired operating point in a set of output variables, yd , for a 
stable plant 4 . 

4 Errors in these calculations have to be compensated for (if sensors are available) 
by integral action in feedback controllers. Note that if set-point changes seldom 
occur, then the transient of the integral action (usually slow) will be irrelevant in 
practical terms. However, if set-point changes are frequent, then a slow correction 
of offsets might be a significant performance drain. 
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If a model (2.10) is available, reaching the desired output means solving 
for u the steady-state equations (derivatives equal to zero). 

In the case of linear state space CT equations, the result is the DC gain, 
(2.59), G = — CA~ 1 B + D, so y d = Gu* = — (CA~ 1 B + D)u* and hence: 

u* =G- 1 y d = (-CA- 1 B + D)- 1 y d (4.12) 

if the DC gain matrix is invertible 5 . 

If the plant is non-square and there are more sensors than actuators, then 
the desired point might be non-reaclrable (if yd is not a combination of the 
columns of the DC gain matrix). Then, only a subset of the outputs must 
be selected, or the whole solution must be solved by least squares, using 
the left pseudoinverse in Appendix B.2, so u* = ( G T G)~ 1 G T yd ■ If there are 
more actuators than outputs, the problem has infinite solutions so a subset 
of the actuators can be fixed or the configuration with minimum squared 
deviations can be also solved by least squares, using the right pseudoinverse : 
u* = G T (GG T )~ 1 y d . 

The most improvement in achievable performance appears when inversion 
of non-linear DC characteristics is implemented directly on the control soft- 
ware. In fact, its generalisation means inversion of dynamic non-linearities. In 
Section 9.5, simple illustrative examples of these techniques will be discussed. 

Experimental determination of the DC gain. Even if a model is not 
available, performance gains can be achieved if, let us say, PID controllers are 
“helped” by suitably incrementing inputs when changing set-points, see (8.5). 
The needed increments can be obtained by using as DC gain the result of a 
step-response identification experiment. If the plant is non-linear, the output 
increments depend on the starting point. Eventually, its evaluation at different 
operating points gives a hint on the plant’s degree of non-linearity. 

Model-free manual control 

Using manual control, by positioning the actuators in a constant setting a 
desired value appears at the process outputs of interest (of course, only in 
the absence of disturbances). Experimental determination of the DC gain 
matrix via step response will allow us, starting at a certain operating point, 
to determine the increments in actuator values to achieve the desired output 
increments. If the plant is non-linear, the output after the change in actuators 
will not be the desired one, but reasonably near, if the non-linearity is not 
very severe. In this case, the same DC gain matrix can be used to iterate a 
couple of steps to approximate the plant’s output to its desired values. 

Example f.6. A mixing tank has two outputs (height y, concentration x), and two 
valves (Va, Vs) acting as inputs. If, starting from an initial situation where both 

5 Note that, for instance, if A is singular, the DC gain does not even exist (the 
plant is unstable as singular A implies eigenvalues at s = 0). 
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valves are opened 30%, the outputs are (0.7 m, 50%), opening valve Va to 40% 
gives, in steady-state, (1 m, 62%). Then, opening valve Vb to reach (40%, 45%) 
yields (1.35 m, 41%). In this case, a coarse approximation to the DC gain is: 



0.3 0.35 

= ( <M -Vll 

0.1 0.15 




(4.13) 



So, a valve increment from the last situation to achieve a set-point (1.5 m,47%) can 
be calculated: AV = G _1 (0.15, 0.06) T . If, due to non-linearity, the set-point is not 
achieved, a second increment may be calculated with the same approximate gain. 



4.6.2 Open-loop Inversion and Trajectory Tracking 

The problem of obtaining a desired output can be formulated for a whole 
trajectory. In DT, if the desired output of a process with model G(z ) is y d {z), 
using the ^-transform, the feedforward action, Uff(z), must verify: 

y d {z) = G{z)u ff (z ) => u ff (z) = G{z)~ 1 y d {z) (4.14) 

which is, for an arbitrary y d , unfeasible as G{z) contains delays. If y d {z) is 
the output of a reference model, M(z), to an external input, i.e., y d (z) = 
M(z)r(z), the open-loop regulator would be: 

u(z) = G(z)- 1 M(z)r(z) (4-15) 

where M(z) must be selected to make G _1 M feasible (proper, with reasonable 
maximum gain in all frequency ranges) and stable. Usually, G~ l should be 
obtained by means of symbolic computation software. If the original plant is 
non- minimum-phase, then G _1 will be unstable, unless M cancels the model’s 
RHP zeros. An analogous derivation can be carried out for CT systems. 

If the model is in state space form, its inverse realisation is given by: 

x k +i = (A - BD~ 1 C)x k - BD~ 1 y k \ u k = D~ 1 Cx k + D~^y k 

Note that it cannot be inverted if D is singular. 

Remark ^.7. The exact tracking of an arbitrary trajectory or reference model 
in discrete-time systems usually causes oscillations in the control variable. 
To avoid undesirable effects, in practical implementations, the control action 
should be filtered with a low-pass filter (including it in M), rejecting higher- 
frequency components that otherwise would excite high-frequency ranges of 
the plant (usually poorly modelled). It is also common to add a notch-filter 
at the Nyquist frequency u s /2, such as the factor 0.5(1 + z -1 ). 

4.6.3 Feedforward Rejection of Measurable Disturbances 

In some cases, disturbances are measurable and a model of their effect is 
available, either from experimental data or from first-principle equations. 
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Example J^.8. Let us consider some common cases: 

• in a tank level-control, feed pressures or flows of the incoming fluids can be 
measured and their effect determined from simple balance equations, 

• in a neutralisation process (pH control), the incoming pH and flow can be mea- 
sured, 

• temperature control: measuring ambient temperature, solar radiation, detecting 
door/ window openings, etc., 

• position control: knowing beforehand the mass of an object to be moved. 

Availability of that information can contribute to improving the performance 
of a control system. 

Let us have a model of the disturbance effect, for example by linearising 
first-principle equations, as (2.21): 

x = Ax + Bu + B d d; y = Cx (4-16) 

No direct coupling between the outputs and the inputs (d and u) is assumed, 
for simplicity, at this moment. 

The simplest case is when the disturbances enter on the input channel 
(i.e., there exists a matrix M such that Bd = BM). In this case, applying the 
control action: 

u = -Md (4.17) 

the disturbances are cancelled, as x = Ax + B(—Md ) + ( BM)d = Ax is now 
independent of d. 

To check if the input channel condition is fulfilled, the system of equations 



Bu = —Bdd 

should be solved for u. The usual situation is the order of the system, n, 
being greater than the number of inputs, m, so there are n equations with m 
unknowns. The least squares solution is: 

u = -{B T B)~ 1 B T B d d 

Perfect disturbance rejection is possible if: 

B d = B(B T B)~ 1 B T B d (4.18) 

and if this is the case, the above formula also yields M. In other case, if 
(/ — B(B T B)~ 1 B T )B d is small compared to B d , then approximate rejection 
can be carried out 6 . 

If the disturbance does not enter on the input channel or, also, if the 
disturbances directly affect the output to be controlled so y = Cx+D d d , D d 7^ 
0, then this proportional feedforward does not work well. Two alternatives 
appear: 



6 B(B T B) 1 B t is a projection matrix, in the sense that it yields the orthogonal 
projection of any set of vectors (at its right side) onto the column space of B. 
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• achieve rejection at steady-state, 

• achieve rejection in some frequency range (or at a particular frequency, 
not necessarily DC, for example, when a system is subject to measurable 
sinusoidal disturbances) by dynamic feedforward. 

Steady-state rejection. The steady-state rejection implies choosing u/f 
such that, in steady-state, with a CT model: 

0 = Ax + Buff + Bdd => x = ~A~ 1 (Buff + Bad) 
y = Cx + Ddd = — CA~ l {Buff + Bdd) + Ddd 

a solution to y = 0 can be found if the following system of equations can be 
solved for Uff. 

— (CA~ 1 B d + D d )d = CA~ 1 Buf f (4.19) 

Depending on the number of sensors, actuators, disturbances and the system 
properties, the problem can have an exact unique solution (if CA~ 1 B is square 
and invertible) or it might need to be solved in a least-squares sense. 

Dynamic rejection: transfer matrix models. The second alternative, 
with more complex implementation, involves calculating the transfer function 
matrix from disturbances to outputs 7 . Let us call it G d {s ) = C(sI — A)~ 1 B d + 
Dd . Then, by applying the control action: 

uff = -G~ l G d d 



it is straightforward to verify that the overall effect of d is zero. However, 
G _1 Gd might be non-realisable so further low-pass filters, F, should be added 
to achieve a feasible implementation: 

Uff = —G~ 1 FG d d (4.20) 

discarding the goal of compensating for high-frequency disturbances. As usual, 
caution is needed with RHP zeros in plant model G. 

Steady-state rejection in TF representation amounts to just calculating 
the DC gain of the above formulae: 

uff = — G(0) -1 Gd(0) (4.21) 

In some cases, the disturbance measurement itself contains some dynamics 
d m = G m d , where d m stands for disturbance measurement. If this is the case, 
the compensation should be replaced by Uf / = —G~ 1 FG d G^d m . 

There are other cases of disturbance effects that have not been considered: 

' In some cases, if the record of the effect of a sudden disturbance is available, 
step-response experimental identification methods (Appendix A. 4) can directly 
determine this transfer function. 
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• the effect of the disturbance is measured through a sensor z = C d x + 
D d d, combining direct measurement plus state information. For exam- 
ple, an outflow in a system that is directly affected by known connec- 
tion/disconnection of one downstream pump (d), as well as upstream tank 
levels (x), 

• unmeasurable disturbances. 

Typically, feedback control needs to be applied in these cases, trying to reduce 
the effect of the disturbance. But it can be complemented with a “feedforward” 
control based on (feedback) estimations of the disturbances, as discussed in 
Section 6.3.2. 



4.7 Two Degree of Freedom Controller 

With the combination of feedforward and feedback control, better control 
performances may be achieved. Feedback control is constrained by: 

• stability issues in the face of uncertainty, 

• tracking/regulation vs. measurement noise filtering performance trade-off, 
and feedforward control, only applicable to stable systems, is limited by: 

• sensor availability (not a problem for references, but for disturbance- 
rejection tasks), 

• performance degrading in the face of modelling error. 

Thus, a so-called 2-DoF control structure can be designed as shown in Fig- 
ure 4.4. In this case, the control action is generated by 




Figure 4.4. Two-degree of Freedom control structure 



u = K[Fr - H{y + n)\ + K d H d d 

where F and K d are feedforward controllers attached to the reference and 
measurable disturbances, respectively, K is a forward path controller, H is a 
feedback controller (and/or a measurement noise filter) and H d is the distur- 
bance sensor dynamics. The output is expressed by: 
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y = (I+ GKH)- 1 ( GKFr + {G d + GK d H d )d - GKHn ) 

So, F can be designed with only tracking in mind, K d for measurable distur- 
bance rejection, as in (4.20), H for high-frequency noise filtering and K will 
try to carry out rejection of unmeasurable disturbances and modelling error. 

Elementary forms of 2-DoF control appear in industrial PID regulators. 
Applying the methodologies presented in Section 7.4, a general 2-DoF opti- 
misation framework is able to solve many disturbance rejection problems of 
engineering significance. A general MIMO 2-DoF structure is further analysed 
in Section 8.4.3. 



4.8 Hierarchical Control 

There are many control goals requiring different algorithms and kinds of infor- 
mation from the process, as mentioned at the beginning of this chapter: from 
the level closest to the process to the plant-wide control. All these activities 
should be connected and some kind of hierarchy is natural. 

Local control. Uses information directly gathered from the process, as fast 
as possible, to generate the reaction of the control to process changes in 
order to fulfill the tracking or regulatory control goals. It also includes 
logic control to handle automata. 

Supervisory control. Evaluates the behaviour of the local controls and com- 
mands change in parameters, structure or components. It may include 
adaptation, as well as emergency actions. 

Coordinating control. Evaluates the performances of the process and deter- 
mines objectives (set-points) for the lower level controls. It may include 
optimisation routines to compute the best operating conditions. 
Plant-wide control. Considers the constraints among interconnected processes 
to optimise the whole plant behaviour. It may include management and 
policy criteria to define goals for the lower controls. 

In digital control, the control algorithm only takes a minimum part of the 
control code, with a lot of activities around the control to ensure its correct 
operation. From an algorithmic viewpoint we must consider, among others: 

- the control algorithm itself, 

- output and state filtering (observers and virtual sensors), 

- scaling and monitoring, 

- connection with starting up and shouting down procedures, 

- alarm treatment, 

- data storage and recovery, 

and from an instrumental viewpoint, also issues related to: 

- data and variables’ representation, 

- timing, sampling and scheduling of tasks, 

- data acquisition systems, 
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Figure 4.5. Plant-wide control schema 



- communication channels and possible delays, 

- human/machine interface, 

shall be considered for the success of the designed control solution. 

4.9 Key Issues in Control Design 

Control goals, variable selection and control structure are key decisions in 
the design of a control system. In any case, once a control system has been 
designed, a validation process is required to determine: 

• the range of validity of the proposed control structure, 

• its robustness to modelling errors, 

• the limitations in achieving some performances due to the process, 

• the limitations in achievable performance due to implementation con- 
straints, 

• the need of use of multiple controllers or adaptation, 

• the tasks to be allocated to a supervisory control level design. 

Some of these issues are introduced in the last chapter of the book, and there 
is a lot of research to develop new approaches related to: 

• integrated design of the process and the controller, 

• iterative modelling and control design, 

• integrated control algorithm and implementation system design, 

• learning controllers. 

Given the control goals, and taking into account the limitations above, a 
suitable control design approach should be followed. This is the matter of the 
next chapters. 
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4.10 Case Study: Ceramic Kiln 

The production process of ceramic tiles involves a number of operations and 
subprocesses. Four main activities should be considered: raw materials grind- 
ing and milling, pressing and compacting the biscuit, glazing, and firing at the 
kiln. Most of the final characteristics of the tiles depend on the firing process. 
The kiln is, therefore, the core of the whole production plant. This case study 
presents some comments about the definition of the control system, in the 
way we proceeded in the framework of a practical implementation 8 . 

Users’ goals. The main goal of the production engineers is to get high pro- 
duction of tiles with a high quality, this being defined by the dimensional, 
tonality and resistance characteristics of the tiles. Direct measurement of some 
of these variables is not easy. Thus, control objectives should be oriented to 
control some accessible process variables so as to (indirectly) keep the tiles’ 
properties within some specified bounds (see Section 5.5.1). We will concen- 
trate on the kiln. 

After an analysis of the firing process, the main control goal should be to 
apply a pre-defined temperature firing profile to each single tile. That means 
not only control of the temperature and time of exposure of each tile during 
its travel within the kiln, but also to keep adequate ventilation conditions, 
strongly affecting the surface properties of the tile, maximising the number of 
tiles per hour. 

The process. A kiln is a long tunnel (70-100 m) with a useful section of 
approximately 1.7 m x 0.5 m, thus, it is a distributed process, where the in- 
ternal temperature and pressure depends on time and position. To simplify 
the model, it is divided into sections. Tiles are transported by rollers in one 
direction and ventilation air is flowing in the opposite direction. In some in- 
ternal sections, combustion units will heat the tiles whereas in some other 
sections external air will cool the tiles. We must also distinguish between the 
upper and lower part of the section (above and below the tiles). The sec- 
tions are functionally grouped in different zones: pre-kiln, pre-lreating, firing, 
forced rapid cooling, normal slow cooling and final cooling zone, Figure 4.6. 
The construction of the kiln (number of sections, distribution of burners and 
fans, rollers, and many mechanical properties) will determine the potential 
production possibilities, as well as the final product quality. The goal of the 
control would be to apply the best actions, constrained to the existing kiln 
hardware. 

Process variables. There are many internal variables in the kiln and inside 
the tiles. The common sensing devices are thermocouples, and pressure, flow 
and speed meters. The actuators are motors (to manipulate the tiles and fan 
speed) and valves (to modify the flow of gas and air). At the kiln exit, some 
tile properties can be measured: calibre, planarity, out-of-square and colour 



European ESPRIT project “MARCK”, 1997. 
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Figure 4.6. Kiln diagram 



properties. Mechanical resistance can only be measured out of line and with 
a great time delay, not being suitable for on-line control of the kiln. 

A large number of variables can be considered and measured for monitor- 
ing purposes. But from the control viewpoint, the measured variables used 
to generate the control actions are defined by the number of manipulated 
variables and their placement. SVD techniques can be used to determine the 
suitable number of control variables, leaving the remaining inputs as constant 
or, at least, only used in changes of the operating conditions. It can also 
provide some hints to select the most relevant temperatures related to each 
burner (up, down, in the same or contiguous cell, ... ). 

Setting up a model. As already described, the kiln can be considered as a 
series of sections (or cells). From the point of view of the thermal behaviour 
inside it, we may consider the kiln scheme shown in Figure 4.7. The post- 
combustion gases flow from right to left, while the tiles advance from left to 
right . A simplified model of the thermal process would be based on first-order 
TF from: 

• a heating burner power to the temperature in the corresponding cell, Gyj, 

• the temperature of a cell to that of the previous one (due to convection), 

Gjy+i, 

• the presence of masses being heated in a cell (tiles, etc.). 

Experimental identification (Section A. 4) could be carried out by introducing 
pseudo-random binary signals (PRBS). The kiln should be operating under 
normal conditions, with local PID flow control of the burners. Three kinds of 
experiments are foreseen: 
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Figure 4.7. Kiln diagram (II) 
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1. Keeping the temperature in a section (i + 1) as steady as possible, intro- 
duce a PRBS-like set-point at the local PID of section i. This allows for 
identifying G^j using a regular RLS algorithm. 

2. Keeping the output of the PID at section i constant, force temperature 
changes at section (i + 1), thus allowing for the identification of Gj^+i. 

3. a RLS algorithm with two inputs and one output can also be used. In 
this case, changes both at the i-tli control action and at the (i + l)-tlr 
temperature should be forced. 

In Figure 4.8, some of the results on a typical kiln are shown. 



Temperature variations at section M012 




PID output variations at section M012 
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Figure 4.8. Identification of the kiln model. Input/output experimental data 



Control structure. A hierarchical control structure seems to be appropri- 
ate. 

• changes in production will determine the set-point of the roller speed. It 
will also provide a feedforward to the gas burners’ flow, as well as changes 
in the kiln internal pressure and ventilation airflow, 

• The final goal, quality control, is based on measurements at the exit of the 
kiln, and the fine-tuning of the temperature profile (and vertical distribu- 
tion) is defined in a qualitative and heuristic way, 

• coordinating control to achieve an actual temperature that is equal to the 
desired reference at each section, T) = r*. To reach this goal, a decou- 
pling control with decentralised feedback (Section 5.3) was implemented, 
keeping the controlled variables at their desired value. 

• local PIDs installed at the burners will provide a lower-level slave control 
trying to assure the demanded gas flows (Section 5.4.1). 
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Decentralised and Decoupled Control 



In many industrial plants, the basic extension of classical PID controller de- 
sign, implementation and timing is the decentralised approach, where struc- 
tural concepts are used to decouple the interaction between variables. The 
use of standard equipment and the ease of hand-tuning or understanding by 
non-specialist technicians are the main advantages of this approach. Never- 
theless, the control effort is decomposed into two stages: first to decouple the 
different subsystems and then to control them. The extra effort rewards con- 
sist in simpler subsequent design, implementation and tuning. This chapter 
addresses some of these issues. 



5.1 Introduction 

In Section 4.3, selection of suitable inputs and outputs was discussed. Those 
inputs had significant effect on key internal process variables and the sensors 
allowed for its determination with acceptable noise sensitivity. 

Decentralised (distributed) control tries to control multivariable plants by 
a suitable decomposition into SISO control loops. It has the advantage of easy 
implementation and tuning if a sufficient number of sensors and actuators is 
available. However, with a limited number of them, a centralised controller 
carrying out matrix operations will be able to squeeze better performance out 
of processes with strong couplings or conditioning problems. 

The key issue behind the use of a centralised strategy is, however, the 
availability of a precise enough model. If it is not available, then lower per- 
formance can be targeted with enough guarantees of success, as discussed in 
Chapter 8. In this case, a wise combination of standard SISO regulators may 
solve the problem with comparable results, with implementation advantages. 

Let us assume that a first selection of controlled variables, actuators and 
measurements is available and let us discuss some possibilities to try to solve 
the problem by use of multiple SISO controllers, first on an independent basis 
and then on a coordinated structure. 
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The design of independent loops may have, if the sensor and actuator 
configuration is adequate, a significative advantage regarding reliability: in the 
event of a fault in another regulator or actuator, the “independent” controller 
will still try to drive its associated variable to its set-point. Note that in 
a system heavily dependent on the coordination of all loops, the failure of 
one component may lead to failure of the overall structure. This may be, 
particularly, the case with the centralised control approach. The reliability 
advantage is one of the multiple appeals to practitioners regarding the use of 
separate SISO loops instead of centralised or heavily coordinated approaches. 
However, this advantage does not apply to all possible plants and sensor- 
actuator choices. 

5.1.1 Plant Decomposition, Grouping of Variables 

In many industrial cases, a complex process can be divided into subprocesses 
so variables can be grouped into several sets corresponding to each subsystem. 
This division corresponds in many cases to actually engineered subsystems 
and, in other cases, it is just a “conceptual” framework for control design. 
Figure 5.1 depicts the basic idea. 



MIMO system 
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Figure 5.1. A MIMO system as a set of coupled simpler subsystems 



The subsystems, however, have some interaction (in the trivial case of totally 
isolated subsystems, they can be handled independently of the rest). There 
are two types of interaction: 

• interference (feedforward interaction). Some variables of a subsystem in- 
fluence other subsystems. However, these subsystems do not influence vari- 
ables of the first one. The key characteristic of this type of interaction is 
that there is no return path to the system originating the interference. 

In the linear case, they can be considered as (additive) disturbances, and 
they have the form of triangular transfer function submatrices. This is the 
typical case of cascaded stages in an industrial facility, 

• coupling. In this interaction, there exists a path of cross-influence so that 
there is a hidden “feedback” loop. Ignoring it in multi-loop strategies can 
lead to instability. 
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Example 5.1. In the TITO plant in Figure 5.1 (right), ui and y\ are related by the 
transfer function g\\. 

However, using a feedback controller, K22, with 112 - 1/2 would inadvertently cre- 
ate an additional feedback path <? 2 i-(loop 2)-gi2, changing the “apparent” transfer 
function from u\ to y\ to: 

Vl = (511 + 312 * K 22 * (1 + A'22322) _ 1 32l)Ml = f flllMl (5.1) 

By g, we will denote the apparent transfer function produced by coupling. Note that 
this is a case of the general LFT interconnection in (2.53). 

From the background of SISO techniques, two basic approaches can be pur- 
sued, depending on the basic requirements: 

• decentralised control tries to divide the plant and design independent 
controllers for each of the subsystems as a way to handle the control of 
the overall plant. In this case, two alternatives arise: 

neglect the coupling. To minimise the risk of bad performance, variables 
should be grouped so that the strength of the coupling is small. This 
is the so-called pairing problem, and the resulting strategy is called 
multi-loop control. It can be guided by common sense if the system is 
built to achieve a structure such as the one in Figure 5.1, but there are 
some approximate model-based tools to help the selection, 
prior to control design, carry out a decoupling operation (“cancelling” 
coupling by transforming the system into a diagonal or triangular struc- 
ture via a transformation matrix). 

• cascade control, adding extra sensors and actuators to improve closed- 
loop performance of a basic control loop. 

Although the grouping can result in MIMO subsystems, for simplicity, the 
extreme cases will be studied in this chapter: on one hand, decomposing a 
MIMO plant into SISO subsystems and, on the other, analysing enhancements 
to a SISO control loop (one set-point) via MIMO techniques. 

Many industrial control systems in electrical, chemical plants, etc. are ac- 
tually designed from these ideas and its combination. A steam boiler and 
distillation column case studies at the end of the chapter will show the appli- 
cation of some of them in a realistic situation. 

Of course, apart from these ideas, there always exists the possibility of 
a centralised matrix-based control calculation, to be discussed in Chapters 6 
and 7. 



5.2 Multi-loop Control, Pairing Selection 

The historically first approach to multivariable control in industry was di- 
viding the sensors and actuators into m subsets and designing control loops 
using one of the sensor sets and one of the actuator sets (selecting those sets is 
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usually denoted as input/output pairing). In this way, a complex control prob- 
lem is divided into m supposedly simpler ones, with no information exchange 
between those controllers. This strategy is called multi-loop control. 

Multi-loop control usually addresses control of a plant with m sensors 
and actuators with m SISO loops, although some of the ideas might apply 
to block-pairing (if centralised control is used for those blocks). For reasons 
of industrial applicability, only the SISO multi-loop case will be considered, 
although block-decomposition of a complex plant is indeed done in the project 
phase, usually based on experience and knowledge of the internals of the 
process (dividing into independent subsystems to be controlled). Some tools 
for the block multi-loop control can be found in [88]. 

In an ideal case, multi-loop control would have the advantages of: 

• flexibility and fault tolerance, as independent loops can be turned on and 
off, due to operator decision or faults, without excessive degradation on 
the performance of the rest of loops, 

• simplicity, allowing independent design of SISO regulators, with easier on- 
line tuning. 

The multi-loop idea is appealing but it may not work in strongly coupled 
systems. Only in truly diagonal or block-diagonal transfer function matri- 
ces can success be guaranteed (and, under some assumptions, in triangular 
plants). In any other case, the loops will be interacting due to coupling, even 
to the point of compromising stability. 

In this case, the objective is to achieve a reasonable level of performance 
in a plant with m SISO controllers, each of them trying to keep under control 
a particular output y 3 by means of manipulating one actuator Ui (from a total 
of m inputs and m outputs). The number of combinations is m! (factorial of 
m) so some criteria should be used in deciding the configuration. 

In many cases, coupling is neglected, being considered as a “modelling er- 
ror” when independently designing each of the loops. This fact limits achiev- 
able performance for reasonable robustness (see Section 5.2.3 and Chapter 
8): “detuning” of some of the SISO regulators (aiming for lower performance 
objectives) can mask unacceptable interactions. 

To successfully apply multi-loop control, a methodology to assess the de- 
gree of interaction between the loops is needed. Apart from, of course, trial 
and error procedures on plant prototypes or fine-tuning and optimising on 
simulations, some conclusions can be drawn if a plant model is available, even 
a rudimentary one, such as an approximation to the DC gain matrix. 

In fact, as high-performance multi-loop control can be difficult to achieve, 
the most popular results on stability and pairing are usually referred to very- 
low-bandwith closed-loops with integral action. In this way, some conclusions 
based on the DC gain matrix can be drawn. Once this low-performance set- 
up has been achieved, specifications can be sequentially increased (see Section 
5.6). 
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Niederlinski Criterion 

The most immediate result on pairing selection is the Niederlinski criterion 

[93]. . 

Given a stable multivariable system G mxm (row and column transposition 
have been done to locate the selected pairings on the diagonal) and a diagonal 
controller with integral action K/s, the closed loop will be unstable if L = 
G(0)/t(0) verifies the sign condition 1 : 

sign(det(L)) ^ sign (II™ (5.2) 

The Niederlinski criterion can exclude many candidate pairings, assuming 
that the sign of the integral gain in k it is the same as that of the DC gain of gu 
(as expected in a decentralised design). In this case, La has positive gain so 
the criterion reduces to det(L(0)) < 0 as a sufficient condition for instability. 



5.2.1 The Relative Gain Array Methodology 

The relative gain array methodology is a widely used screening tool to help 
determine if a particular input/output pair (say, y t and Uj ) is a wise choice for 
implementing a SISO control loop, in the sense that coupling and interaction 
with other loops will be small, refining the Niederlinski result. 

Let us detail the basic ideas behind the approach, by considering the TITO 
system in Figure 5.1 (right), analysed in Example 5.1. 

Example 5.2. In the referred example, coupling transforms the relation between m 
and y\ from gw to gu in (5.1). If g n and gu were similar, a controller designed on 
the open-loop characteristic, gu, would also work when loop 2 is closed. However, 
we would like to know this possibility before actually spending time in designing the 
controllers, and gu depends on K 22 for which a similar analysis should be made 
with g 22 . 

An approximation may assume that output 2 will be “well controlled”, this 
implying (l + (?22 A' 22) -1 « 0, i.e., K 22 having a big gain. In this case, with K 22 — > 00 , 
(5.1) becomes: 

9 11 ~ flu + fli 2 fl 22 1 fl 2 i (5.3) 

So, if a controller is designed on g n, dependence with the to-be-designed controller 
for loop 2 is not significant as long as loop 2 performs well. 

Let us discuss the general case. In open loop, the transfer function between 
output yi and input Uj is gtj, as: 



n 

y = G(s)u yi = ^2 9ikUk (5.4) 

k=l 

1 It is a generalisation of the well-known SISO criteria: “a process with negative 
DC gain and positive integral action gain Ki is unstable”. 
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then experiments with all inputs except Uj equal to zero will produce output 
Vi = 9ij u j ■ It will be assumed that G(0) is non-singular 2 . 

Now, let us think on the extreme case in which all outputs except yi are 
under “ perfect ” control, i.e ., very close to its operating point (zero in linearised 
coordinates), by using all actuators except Uj (left for a not-yet-implemented 
SISO control jointly with sensor yi). The configuration is depicted in Figure 
5.2. 



Plant 



■Vi 



m - 1 
controller 



Plant 



Figure 5.2. Multi-loop control: all loops open (left), all except one closed (right) 



Obviously, if a “step” or any other prescribed input were applied to Uj, the 
control system would try to counteract the effect of this input on the controlled 
outputs (because, due to coupling, it will act as a “disturbance” on them). 
So, the control actions {iq, . . . , Uj_\, Uj+i, . . . , w„} will not be zero, and the 
outputs {yi, , 'iji-i, yi+i, . . . , y n } will be approximately zero if the control 
is well designed. 

Let us consider the mathematical inverse relation to that in (5.4), 

n 

u = G~ 1 (s)y m = tikVk (5.5) 

k = l 

where tik is the corresponding element of the inverse transfer function matrix 
G _1 . Particularising for u 3 and replacing all controlled outputs by zero, and 
inverting the result to have the correct causality, we have: 

1 

Uj — tjjlji =£* yi — - Uj = g i:j Uj 
tji 

The transfer function g^ = 1/tji is an apparent transfer function (it is a 
closed-loop transfer function with a perfect controller). 

So, if is “similar” to gij, the presence of the rest of the controllers will 
not influence the behaviour of a SISO loop designed on the model gij, and 
it will be a “good” candidate for an independent loop. A way of measuring 
“similitude” between g t .j and g^ is checking if its quotient is near 1: 

2 Otherwise, the system would have a zero at s = 0 and some combination of 
outputs would not be controllable in steady-state. An SISO example would be 
s/(s + l), unable to be driven to a non-zero set-point without an unbounded ramp 
input. 
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= r wl =* >*=9^*1 (5-6) 

Evaluating A,;j for all possible pairings yields the so-called relative gain 
array A(s). It is straightforward to realise that it is evaluated by element-by- 
element multiplication (x) of G and its inverse transpose: 

A*) = G(«) x (G(s ) T ) -1 

The RGA is scaling-independent and controller-independent. 

The RGA was introduced in [33] and, for ease of computation and model 
availability, it is usually evaluated at zero frequency 3 (DC gain). The ideas ob- 
viously apply only to regulators without significant gain at higher frequencies 
(regulators with only integral action). 

These coefficients can be interpreted as the ratio between the open-loop 
SISO static gain and the gain with “perfect” control on the rest of the loops, 
using the other input variables. 

In Matlab®, the element-by-element product uses notation . *, so: 

gO=dcgain(sys) ; rga=gO . *inv(gO 1 ) 

Triangular plants. Triangular plants have the identity matrix as the RGA, 
and they are easier to control. Without loss of generality, let us assume an 
upper triangular plant. In this case, the deviations in loop j act as disturbances 
gij to the upper ones (i < j), but the reciprocal does not hold (gji = 0). So, 
there is only one-way interference. Sequential design from i = m to 1 of the 
control loops will ensure success. 

Rules for Pairing Selection 

Some rules of thumb from the previous arguments can be stated as [119]: 

• \{j « 1: the pairing yj-Ui is a good candidate for an independent SISO 
loop, 

• A ij < 0: the apparent transfer function has a different sign to the open- 
loop one, so there is a chance of a miscalculation of the sign of feedback, 
leading to instability. It can be shown [119] that, with integral action 
controllers, using a negative-RGA pairing will lead to at least one of these 
three situations: (a) unstable all-closed loop, (6) unstable stand-alone loop 
(referring to the one with negative RGA), (c) unstable m-minus-one loop 
(if the loop with the negative relative gain is opened, due to faults or 
saturation) . 

3 In processes with integrators in open loop (infinite DC gain), if integrators can 
be “pulled out” in such a way that they can be considered part of a regulator (if 
they appear before a particular input or after a particular output), they can be 
removed from the plant model and the RGA methodology can still be used. 
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• A ij small (positive): The apparent closed- loop “gain” is much higher than 
that of the open loop. This can cause performance degradation or even 
instability when closing the loop. It pinpoints an input that has little 
effect on a particular output in open loop but with significant effect in 
closed loop due to coupling and feedback. Probably not a good pairing 
candidate, 

• Xij big (positive): the open- loop gain is higher than that of the closed 
loop, so control may become ineffective when closing the rest of the loops. 
Furthermore, large RGA elements may indicate difficulties in control due 
to uncertainty (see Remark 5.6), irrespective of the chosen pairing. 

Pairings decided by these rules should be compared against other options from 
common sense or insights into the process internal mechanisms. 

Example 5.3. A system has a DC gain matrix given by: 

/ -1 1.5 2.8 \ 

G(0) = 4 1.6 4 

\ 0.15 2 -0.1 / 

Evaluating its RGA, 

g=[-l 1.5 2 . 8;4 1.6 4;. 15 2 -.1]; rga=g. *inv(g’ ) 
rga = 0.2600 0.0478 0.6922 

0.7328 -0.0163 0.2835 

0.0073 0.9685 0.0242 

the recommended pairings would be i/ 2 -ui, 2 / 3 -M 2 and yi-113 if SISO PI controllers 
are used in first place. For example, the apparent all-loops closed transfer function 
for y\—U2 has a gain of: 31.4 (l/t 2 i), 21 times higher than the open-loop one of 1.5! 

RGA with full frequency response. The previous considerations have 
been taken on the basis of the DC gain matrix, and only apply to low-gain 
integral action. However, for more demanding control specifications, depend- 
ing on actuator bandwidth and directionality variations with frequency, the 
full Bode diagram of A should be drawn. 

In this case, at frequencies important for control stability robustness, i.e., 
around the peak of sensitivity (4.5) or complementary sensitivity (4.6) (see 
Section 8.5, in particular Equations (8.11), (F.2)), if A(ju) approaches the 
identity matrix, indicating that the plant is triangular, stability problems are 
avoided in multi-loop control [119]. Note that the matrix in this case has 
complex numbers as elements. 

The condition may be a hard one to meet, but, in some cases, it might 
point out alternative pairings to those from only steady-state considerations if 
higher performance (with decentralised control) must be attained. As another 
tool, the achievable bandwidth for different pairings may be assessed using 
(5.13). 
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Remark 5.f. Note also that if the process is unstable or non- minimum-phase, 
G _1 will have RHP zeros or poles respectively so the apparent transfer func- 
tions may suffer substantial changes with respect to the open-loop ones. In this 
case, the RGA indications at steady-state will not reflect the whole situation. 

Example 5.5 (TITO system). In the 2x2 case (Figure 5.1), the RGA matrix is: 



A = 



( An 1 — An \ 
\ 1 — An An / 



An 



1 



GhG 22 



(5.7) 



and, with a diagonal controller (Ki, K 2 ), the closed-loop characteristic equation is: 



CE(s) = 1 + A'iGh + K 2 G 2 2 + AlA2 . GllG22 (5.8) 

An 

This shows the relationship between relative gain and closed-loop stability. If 
An ~ 1, the characteristic equation reduces to (1 + AiGi)(l + K 2 G 2 ). 



Remark 5.6. Incidentally, the RGA helps in evaluating the maximum size of 
perturbations on a particular matrix element so that the matrix does not 
become singular. In particular, a matrix A becomes singular if a single element 
aij is perturbed to a' ; - = o,j( 1 — A”- 1 ). The result is meaningful in analysing 
sensitivity to element-by-element uncertainty in experimental identification 
of ill-conditioned processes. Also, the sum of the absolute value of all RGA 
matrix elements is, orientatively, close to the minimised condition number 
(page 292): plants with large RGA elements are usually difficult to control 
(due to sensitivity to uncertainty). For example, the RGA of the plant in 
Example B.6 is identity, i. e., probably indicating that the chosen configuration 
will not pose significant control problems. 



Disturbances: RDG 



To try to account for possible amplification or attenuation of the disturbance 
response for a particular candidate pairing, if a rough disturbance model is 
available, the relative disturbance gain (RDG) Pi for a disturbance d can be 
defined [121] as the ratio between the change in control effort required to 
counteract d on loop i when the rest of loops are closed vs. the case they are 
open. The pairing is assumed already selected. 

In the 2x2 TITO case, for a process with steady-state gain 



3 ii 9 12 
321 322 



hm 

b-D2 



the RDG gains are: 



/3i = A n (l— p 2 = \n(l 
V h D1 g 22 J \ 



hmg2i \ 
hD29ll ) 



(5.9) 



(5.10) 



where An is the (1, 1) element of the RGA matrix. 

Values of \P\ < 1 indicate a beneficial interaction (the loops cooperate) and 
values bigger than 1 indicate that closing one loop exacerbates disturbance 
effects on the other (at low frequencies). 
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5.2.2 Integrity (Fault Tolerance) 

As previously commented, an interesting feature of multi-loop control is that 
in the event of failure of one of the loops, the rest will keep trying to achieve 
their target set-points. In this way, multi-loop structures might be more fault- 
tolerant than centralised or decoupled ones. 

A multi-loop controlled system has integrity if the closed-loop system re- 
mains stable as subsystem controllers are arbitrarily brought in and out of 
service [35]. 

Integrity allows for any arbitrary order in the connection and disconnec- 
tion of individual loops. A system not verifying the integrity property may 
yield instability in intermediate configurations if loops are connected or dis- 
connected in a particular order. It may also have stability problems if some 
manipulated variables are driven to saturation. 

As the failure of one of the loops changes the “apparent” transfer functions 
calculated above, fault tolerance is not guaranteed unless specifically checked. 

Usually, conditions on the DC gain allow for checking integrity with a 
set of very-low-band width integral-action regulators. This is named integral 
controllability with integrity (ICI). 

A necessary condition for ICI is that the RGA elements of the selected 
pairing are positive [35, 119]. This is one of the main practical reasons for 
avoiding negative RGA pairings. The condition is not sufficient, however. Ad- 
ditional considerations appear in [35]. 

In particular, a more restrictive necessary condition, assuming the selected 
pairings are diagonal ( yi~Ui ) (there is no loss of generality as G(0) can be 
transformed to verify that by straightforward input or output reordering), the 
RGA of any submatrix of G(0) obtained by elimination of any combination 
of loops (eliminating the j- th row and column from G(0)) must also have 
positive diagonal terms. 

Example 5. 7. For a system with DC gain: 

/ 56 66 75 97 \ 

, . _ 75 54 82 28 

“ 18 66 25 38 

\ 9 51 8 11/ 



the RGA matrix is: 



6.1559 


-0.6948 


-7.9390 


3 . 4779 


-1.7718 


0.1018 


3.1578 


-0.4877 


-6.5985 


1.7353 


8.5538 


-2.6906 


3.2144 


-0.1422 


-2.7726 


0.7004 


pairings yi - 


m 4 , J/2-W3, 


V3-U2, 2/4- 


in are selected (other three combinations 



are possible with positive RGA elements). Reordering inputs, the transformed G is: 

g2 = 97 75 66 56 

28 82 54 75 
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38 25 66 18 

11 8 51 9 

Eliminating the column and row corresponding to loop 2, the remaining 3x3 matrix 
has an RGA calculated by: 

sel=[l 3 4]; g2=g2(sel,sel) ; rga=g2 . *inv(g2 ’ ) 

with diagonal terms { — 1.167(i), 0.629(3), 1.301(4)}. So, loop 1 would not be a desir- 
able pairing if only loops 1-3-4 were working: a fault on loop 2 will leave the system 
in an undesirable state, either because the loops are already unstable or because 
disconnection or saturation of loop 1 will cause instability. 

So, this configuration does not have the ICI property. It can be checked, by 
inspection, that any other pairing combination also has these problems. There are 
the following engineering alternatives: 

• a redesign of the actuator and sensor locations, 

• coping with the possibility of transient instability in start-up and close-down 
or under a particular combination of faults (maybe establishing a suggested 
sequencing of the start-up, close-down and fault-handling procedures), 

• pursuing a centralised strategy, given that the fault tolerance and flexibility of 
the decentralised one may not be satisfactory enough, 

• try multi-loop control on some combinations of inputs and outputs with lower 
coupling (however, that may lose the physical interpretation of the signals). This 
strategy is outlined in Section 5.3.3. 

As an exercise, it is left to the reader the simulation of the connection and discon- 
nection of multi-loop controllers with a system such as G* l/(s+ 1) and controllers 
0.05(s + l)/s in Simulink® , checking that 1 -2-3-4 is a suitable start-up sequence 
avoiding instability, but loops 3-4 alone are unstable. 



Some remarks on pairing selection 

As real plants are non-linear, the best pairing selection may depend on the 
operating point, as the linearised models do change. For an example, see the 
mixing process case study (Section 5.8.2). 

The best performing multi-loop control system is not always the one giving 
the least steady-state RGA interaction. This issue arises from possible changes 
in interaction direction at higher frequencies and also due to directionality 
effects on the action of disturbances: the best performing pairing may depend 
on the disturbance being considered, as discussed in Section 5.2.1. 

So, the numerical methods of pairing selection are far from conclusive and 
many other considerations might need to be made by the control engineer. 
Good designs with negative RGA pairings occur very infrequently but ap- 
plications are reported where those ones might be the best choice [12, 89], 
although losing integrity. 
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5.2.3 Diagonal Dominance (Stability Analysis) 

Given a transfer function G, let us denote by G the one formed by its diagonal 
elements. These diagonal elements are used for timing a multi-loop regulator 
K , if suitable pairings are found, to obtain a diagonal T closed-loop function. 
When the regulator is put into the real loop, denoting the relative error: 

E = (G — G)G~ l (5.11) 



it can be shown that: 



(I + GK) = (I + ET)(I + GK) (5.12) 



so “multi-loop behaviour” = “interaction analysis” * “nominal individual 
loops”. As the nominal loops will be stable, the overall loop will be stable 
if (/ + ET) does not have RHP zeros. If the plant is diagonal-dominant, then 
E is small. To be more precise, Gershgorin’s theorem (Section B.3) enables 
us to derive the following limitation on the designed- for performance T [119] 
from the Gerslrgorin radius Qi in (3.37): 



\U(ju)\ < 



1 9n(jv)\ 



i 



Vi, Vw 



(5.13) 



These conditions refers to row sums. Substituting gij for g 3l results in a differ- 
ent condition based on column sums. This is a sufficient condition for closed- 
loop stability. If g ij, j ^ i are small (diagonal-dominant plant), the above 
bound is a large number, indicating that good control can be achieved at that 
frequency. 

The frequency for which Qi ss 0.5 can be considered as an orientative 
designed bandwidth limit for multi-loop control 4 . If it is too low for a prac- 
tical application, decoupling may be considered, at least at low frequencies 
(discussed in next section). 

Note that (5.13) guarantees multi-loop stability but, as it is a conservative 
bound, stabilising regulators yielding faster loops may exist. Other sufficient, 
less conservative conditions can be derived from structured-uncertainty anal- 
ysis (Section 8.5.4) [119], but they are beyond this book’s scope. 



5.3 Decoupling 

In cases when multi-loop control is not effective in reaching the desired speci- 
fications, a possible strategy for tackling the MIMO control could be to trans- 
form the transfer function matrix into a diagonal one. This strategy is called 
decoupling. 

4 Assuming the usual SISO criteria (for second- and higher-order plants) regarding 
design of ti so its peak is less than 6 dB. 
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If the resulting transfer function matrix were diagonal (or, approximately, 
diagonal-dominant, (5.13)), then MIMO control would be equivalent to a set 
of independent control loops. Decoupling can be achieved in two ways: 

• feedforward cancellation of the cross-coupling terms, 

• based on state measurements, via a feedback law. The advantage of this 
second approach is that the decoupler can be cast as a gain matrix (static 
system). 

5.3.1 Feedforward Decoupling 

As seen in Section 4.6.2, adding a pre-compensator transforms the open-loop 
characteristic into M (s) , at the will of the designer (except RHP pole-zero can- 
cellations and realisability considerations). Then, any SISO design methodol- 
ogy will finish the overall design if M is chosen to be diagonal. 

Once a Kd = G~ l M open-loop controller is available, it can be used as a 
decoupler in an enclosing feedback loop (see Figure 5.3). 




Figure 5.3. Decoupler pre-compensator block-diagram 



Example 5.8. A transfer function matrix such as: 

G(s)= (± 

V s+7 s+4 J 

can be expressed, converting rows to a common denominator as: 

G(s) = M(s)N{s) = 

Hence, inverting the N(s) matrix containing the numerators: 

= 1 ( — 0.25(s + 7) — 5(s + 7) \ 

K> 16.5s 2 + 196.5s + 567 \ -3(s + 4) 6(s + 14) ) 

if the process is multiplied by A(s)^ 1 , a diagonal regulator, K(s), can be designed 
for the “transformed” plant M(s) (note that the regulator to be implemented would 
be a non-diagonal N(s)~ 1 K(s), contrary to the multi-loop case). 

If G were non- minimum-phase, TV -1 would be an unstable system so this 
simple strategy would not work. In this case, the desired transfer function 
M must include the model RHP zeros for internal stability of the resulting 
decoupled loop. Let us show this idea with an example: 



(s+7)(s+14) 

0 



(s+7)(s+4) 



6(s + 14) 5(s + 7) 

3(s + 4) — 0.25(s + 7) 
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Example 5.9. Given a plant and its inverse: 



G(s) 



1 fs + 2 4 \ 

(a + !)(* + 2) ^ -2 -1 )' 



f~i- 1(„\ _ ( s + l)( s + 2 ) / — 1 -4 \ 

G (s) ~ ++ V 2 s + 2 ) 



the target decoupled dynamics must have the factor (6 — s) in all numerators in 
the diagonal so the decoupler G _1 M is stable and RHP cancellations are avoided: 
spreading RHP zeros into several channels is a trade-off inherent to most decoupling 
cases 5 : the decoupled plant must have two RHP zeros (at the same value of s, but 
with different directions). 

However, non-diagonal target models allow avoiding duplication of the zero and, 
furthermore, assigning it to a particular output. 

In the case under consideration, 



G( 6) 



1 

56 



8 4 

-2 -1 



effectively loses rank: the output zero direction, yT = (1,4), is “unaffected” by input 
components of the form e 6t . So, the zero at s = +6 is “near” output 2. 

To avoid cancellation, the target behaviour M(s) must keep this “zero-gain” 
mode, i.e., it must also fulfill y^M( 6) = 0. The diagonal factor M a below indeed 
fulfills the restriction, but Mb and M c do as well (controller G~ 1 M C shown as an 
example) : 



M a = 



6 — s 
6+s 

o 



0 

6 — s 
6+s 



M b = ( 6 + s ( 6 + s ) 

(s + 2)(s + 1) 
5 + 6 



G~ 1 M C = 



_ / 1 0 
M c — I -Q.5s 6+s 
V 6+s 6+s 

-1 -4 

0.5(s + 4) (s + 2) 



(5.14) 



So, with a bit of additional straightforward work, a feasible M can be built so that 
decoupling is achieved only at low frequency (M a ( 0) = Mj,(0) = M c ( 0) = I), but 
the RHP zero manifests on only one of the outputs. As the zero direction is more 
“aligned” with output 2, the dynamic interaction is lower with M c (compare the 
numerators in the off-diagonal terms in M i, and M c ). The resulting triangular plant 
is easier to control than the original one. 



The procedure in the example can be easily extended to systems with more 
than two outputs [119]. The RHP-related ideas here discussed apply to de- 
coupling, feedforward control and also to achievable performance in feedback 
control. Similar issues would arise when decoupling unstable systems, regard- 
ing the spreading of the unstable dynamics to several channels. 

Approximate decoupling. To design low-bandwidtlr loops, insertion of the 
inverse DC-gain before the loop ensures decoupling at least at steady-state. 
In some cases, a simple DC decoupling may significatively increase the band- 
width limit determined by (5.13) for a subsequent multi-loop design. If further 
bandwidth extension is desired, an approximation of G^ 1 valid in low frequen- 
cies can be used (such as inversion of slow-timescale reduced-order models, 
Section 3.10). 

5 In the case when the RHP factor does not appear in all factors in the inverse, 
spread to all channels can be avoided. Those plants are said to have pinned zeros. 
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5.3.2 Feedback Decoupling 

Some decoupling strategies can be built for linear systems (and some non- 
linear ones, see Section 9.5.3) if the state is measurable. 

Let us assume a system with m inputs and m outputs to be decoupled, 
whose equations are in the usual form : 

x = Ax + Bu\ y = Cx + Du 



Let us consider a particular output yi, to obtain the “shortest” direct 
relation to input u. Perhaps y,; does not depend on u if the *-th row of D , 
denoted as iD, is zero. In this case, its time derivative, by applying the chain 
rule, can be shown to have the form ( iC denotes *-tlr row of C): 

jji = id = i CAx+ iCBu (5.15) 

If iCBu = 0, the second (j/j = 4 CA 2 x + iCABu ) and successive derivatives 
will be taken until there exists an ri so that u appears on its expression 
(CA ri ~ 1 B ^ 0). This Ti is denoted as the output relative degree , and in CT 
linear systems it is the minimum pole-zero excess, so: 

= iCA ri x + iCA ri ~ 1 Bu (5.16) 

By carrying out the same operation for all outputs, and stacking all output 
derivatives into one vector, the result is: 



/ d ri y i 
I dt r i 



y = 



d r ™Vm 

dt rrn 



( i CA r ' 



\ mCA r 



( 1 CA^-'B 



= Hx + Qu (5.17) 



V rnCA 



I'm 1 



B 



where H and Q are constant matrices that can be easily calculated. Then, if 
x is measurable and the control action applied is the state feedback: 



u = Q 1 (^v — Hx'j = —Kpx + Fv (5.18) 

I< D = Q- 1 !!- F = Q- 1 (5.19) 



where v is, at this moment, an arbitrary auxiliary input, the process equations 
get transformed into: 

y = v 



and, explicitly writing the components of y, the result is: 



dt l 



y(s) = 



f-k 0 

0 



0 ^ 

0 



:;(s) 



(5.20) 



V o 0 ••• lk) 



So, the system is transformed into a diagonal one in terms of the auxiliary 
variable. 
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Example 5.10. Let us have a TITO linear system x = Ax + Bu, y = Cx with: 



A = 



1 1 0\ 




( 1 1 


0 2 0: 


; 5=1 


-1 1 


0 13/ 




O 

O 



C = 



1 0 0 
0 0 1 



Let us consider output yi = *i. As it does not directly depend on u (D = 0), 
its first derivative will be taken: 



dyi 

dt 



= l Cx = *1 = Xl + X 2 + Ul + U 2 



dy2 

dt 



— *3 = X2 + 3*3 



still not depending on u, so further derivatives must be taken: 



d 2 y 2 
dt 2 



= *2 + 3*3 = 5*2 + 9*3 — Ml + U2 



(5.21) 



so the relative degree of yi is n = 1 as inputs directly affect its derivative. 
Let us now consider 3/2 = *3 (not depending on u). Its derivative is: 



(5.22) 



Finding that the relative degree is *2 = 2, joining (5.21) and (5.22), the resulting 
expression for (5.17) is: 




1 1 0 
0 5 9 




so, as Q is invertible, the state feedback law (5.18) is: 



u = 





1 1 0 
0 5 9 




and the system is transformed to a new state space realisation: 



/0 0 0 \ 

A = A-BQ~ 1 H =0-39 
\0 1 3/ 



B = BQ- 1 



C = C 




D = D 



with, indeed, a third-order transfer function: 




(5.23) 



(5.24) 

(5.25) 



(5.26) 



State feedback changes the position of the poles of the system (see Section 
6.1.1). Looking at (5.20), the zeros of the system, if any, are cancelled. The 
most important condition for feedback decoupling is that the system must 
be minimum-phase. Otherwise, unobservable “cancelled” dynamics will be 
unstable 6 . 

6 In the example above, the original system had no transmission zeros, so there is 
no cancelled dynamics (the decoupled system is still third-order). 
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Remark 5.11. Decoupling transforms the system into independent integrator 
transfer functions. However, as well as in SISO control, integrators in the plant- 
do not guarantee offset-free disturbance rejection in all cases. Furthermore, 
regarding offset-free tracking, it is (ideally) guaranteed, but the integrators 
will “disappear” under modelling errors. So, integral action in the controller 
may still be needed for the decoupled loops. 

Discrete systems. The above procedure must be implemented in continuous- 
time to achieve a decoupled regulator. Otherwise, discretisation errors do oc- 
cur. So, to implement this strategy, fast sampling must be used. 

The procedure can be applied directly to discrete models if, instead of 
derivation of y, the magnitudes yk+i, etc. are calculated until Uk appears. In 
the linear case: yu = Cxk, yu+ 1 = CAxk + CBuk, if CB = 0 then yu +2 = 
CA 2 Xk + CABuk- By an analogous methodology, a diagonal transfer function 
with elements z~ ri can be built 7 . 

Some Remarks on Decoupling 

Although at first glance, decoupling seems an appealing idea, there are some 
drawbacks: 

• as decoupling is achieved via the coordination of sensors and actuators 
to achieve an “apparent” diagonal behaviour, the failure of one of the 
actuators (stuck valve, saturation) may heavily affect all loops. In contrast 
to this, multi-loop control (Section 5.2) might have a certain degree of fault 
tolerance as each loop will try to keep its operating point irrespective of 
other actuator or sensor failures, 

• decoupling cannot be, in general, achieved with standard industrial reg- 
ulators so the advantage over centralised control is only the ease that 
separation provides in design: decoupling is usually a design strategy for 
centralised, computer-controlled implementations, 

• a decoupling design (inverse-based controller) may not be desirable for all 
disturbance-rejection tasks, unless the disturbances enter independently 
at each output as well. With other disturbance models, a consideration of 
the correlation (coupling) in the disturbance channel could lead to better 
designs, achieving similar levels of disturbance rejection with lower input 
usage [119], 

• many MIMO non-minimum-phase systems, when feedforward decoupled, 
increase the RHP-zeros multiplicity so performance limitations due to its 
presence are exacerbated. Feedback decoupling does not work in that case, 

' In most sampled-data systems with no pure delay, the first sample already de- 
pends on Uk- However, if the underlying continuous system has a high relative 
degree or sampling time is small, matrix Q will be ill-conditioned, so decoupling 
will lead to large control actions and sensitivity to model errors. Note also that 
minimum-phase continuous systems may exhibit zeros outside the unit circle when 
discretised. 
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• decoupling may be very sensitive to modelling errors, specially for ill- 
conditioned plants (although that kind of plant is difficult to control by 
any method, due to its big sensitivity to actuator imprecision), 

• feedback decoupling needs full state measurements. Full state feedback 
has good robustness properties but stability and performance robustness 
margins of decoupling-based loops using estimated states (Section 6.2) 
must be explicitly checked (see Chapter 8). 



5.3.3 SVD Decoupling 

A matrix M can be expressed, using the singular value decomposition as 
M = U SV T , where U and V are orthogonal matrices and £ is diagonal. 

The SVD can be used to obtain decoupled equations between linear combi- 
nations of sensors and linear combinations of actuators, given by the columns 
of U and V, respectively. In this way, although losing part of its intuitive 
sense, a decoupled design can be carried out even for non-square plants! 




Figure 5.4. SVD decoupling: Kd is a diagonal controller designed for E. 



If sensors are multiplied by U T and control actions are multiplied by V, 
as in Figure 5.4, then the loop, in the transformed variables, is decoupled, 
so a diagonal controller Kjj (such as a set of PIDs) can be used. Note that 
set-points must also be multiplied by U T to be expressed in the same units 
as the transformed outputs. Usually, the sensor and actuator transformations 
are obtained using the DC gain, or a real approximation of G(ju>), where u> is 
around the desired closed- loop bandwidth. 

The transformed sensor-actuator pair corresponding to the maximum sin- 
gular value is the direction with biggest “gain” on the plant, that is, the 
combination of variables being “easiest to control” . The lowest singular value 
is the most difficult combination to control. 

In ill-conditioned plants, the ratio between the biggest and lowest singular 
value is large (for reference, greater than 20) . They are very sensitive to input 
uncertainty as some “input directions” have much bigger gain than other 
ones. If actuators are imprecise, when trying to control the “low-gain” output 
combinations, high actuator amplitudes are needed, so actuator imprecision 
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causes big disturbances in the “high-gain” ones. An exception to this is if V 
(or a reordering of it) is diagonal-dominant. 

If the “difficult” combinations (at crossover frequencies) do not have a 
higlr-gain regulator, this design gives reasonable controllers in terms of ro- 
bustness [59, 119]. On the contrary, if the same requirements are posed for 
all directions, sensitivity to actuator uncertainty may be high. For reasonable 
robustness, it is advisable to have similar controller gains in all the loops. 

SVD and the pairing selection 

SVD decoupling produces the most suitable combinations for independent 
“multi-loop” control in the transformed variables, so its performance may 
be better than RGA-based designs (at the expense of losing physical inter- 
pretability). 

If some of the vectors in V (input directions) have a significant component 
on a particular input, and the corresponding output direction is also signifi- 
cantly pointing to a particular output, that combination is a good candidate 
for an independent multi-loop control, so SVD decomposition may also help 
in the pairing selection problem for multi-loop control. 

If, as usual, SVD and RGA are only evaluated at steady-state (zero fre- 
quency), the conclusions will apply only to low-gain proportional or integral- 
action regulators. 



5.4 Enhancing SISO Loops with MIMO Techniques: 
Cascade Control 

Cascade control refers to the design of a control loop for one primary variable 
by means of multiple sensors and/or actuators and, in its basic configuration, 
it consists of two cooperative SISO control loops with different time constants. 
This difference allows for separate design using conventional techniques. It is 
widely used in practice, sometimes in a transparent way (embedded into the 
electronics of a servoactuator, controlled power supply, etc.). 

There exist two basic configurations: 

• the output from a regulator is the reference to another one, 

• the output from a regulator is the “sensor” to another one. 

These configurations can be freely combined in a general situation. Their 
importance lies in the fact that they allow handling control of non-square 
systems with SISO techniques or, as an alternative interpretation, they allow 
improving performance by adding extra sensors and actuators while still using 
SISO techniques. 

If there is not a substantial difference in time constants, although this 
strategy can still be pursued, the loop design cannot be made independent and 
based on SISO techniques, so tuning is not intuitive: centralised configurations 
might be preferable. 
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5.4.1 Case I: Extra Measurements 

In many cases, a faster extra measurement of a secondary output is available. 
This is the case in speed measurements in mechanical systems, current mea- 
surements in switched power supplies, flows in process control, or readings of 
the actual position of an electro-pneumatic valve. 

An example of that situation and the cascade-control loop appears in Fig- 
ure 5.5, where a flow meter outputs a reading, q , and this flow fills a tank. 
The tank level, h , is the primary variable for which a reference exists. 




Figure 5.5. Two-sensor, one actuator, cascade control 



On a first trial, a SISO control could be pursued by using a regulator for 
the whole valve + tank plant. However, as valves are significantly non-linear 
and feed pressure can vary depending on upstream connection-disconnection 
of additional equipment, the performance with this first controller structure 
may be far from optimal. 

Of course, if a non-linear model of the valve (and its hysteresis, etc.) were 
available, a non-linear controller could try to invert it. If the valve were linear, 
all the state variables from the plant could be observed with one sensor and 
then control could act by reconstructing the flow measurement, if needed, 
from the observer. However, the approach has two significant drawbacks: 

• the need of a model of the valve (possibly non-linear) , 

• the sensitivity to measurement noise of the estimations of internal variables 
based on the readings of h: estimates need to be filtered for a significant 
time and by then, the effect of pressure drops becomes significant so that 
higher control actions are needed. This issues will be discussed further in 
Chapter 8. 

In practice, these drawbacks are solved by adding a flow sensor and using 
cascade control. 

The best way to improve performance in practice and reduce sensitivity 
to modelling errors is to use additional sensors and/or actuators. 

This extra measurement will provide disturbance and modelling error re- 
jection before its effects are manifested on the “slow” subsystems. In this way, 
the use of the extra sensor can provide significant performance improvement 
over any alternative using only one sensor, as well as reducing sensitivity to 
modelling errors on the valve (both regulators, for simple systems, can be 
tuned using model- free techniques). Furthermore, dividing into two “tasks” 
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the control action, each of the transfer functions may have a lower order than 
one overall controller: PIDs can be successfully used for lrigh-order uncertain 
plants. 

Cascade control in this configuration is especially useful if the inner loop 
is significantly faster than the outer one. The outer controller is named as the 
master controller, and the inner one is the slave controller. The equations are: 



u = K sl 

ave * ( r s i ave Vinner) i T slave — K master * ( T outer Vernier ) (5.27) 



If time constants are similar then a centralised implementation and joint 
calculation can be given: 



V — I\lU inner T A 2 V outer 

where K\ and K 2 must be calculated together (for example with the observer 
+ state feedback methodologies in Section 6.2). No master-slave interpreta- 
tion can be given in this case. However, performance or robustness improve- 
ment can be achieved with two sensors. 

After presenting the basic ideas for robustness analysis in Chapter 8, Case 
Study 8.8.1 on page 244 outlines a simple justification on why cascade control 
does work. Example F.6 on page 329 also presents another case of improving 
robustness margins by addition of an extra sensor. 



5.4.2 Case II: Extra Actuators 

In some cases, there are more manipulated variables (actuators) than inputs 
to the controller and those actuators have different bandwidth and saturation 
limits. 

In Figure 5.6, a schematic block-diagram of the cascade structure is shown. 
In the diagram, u\ is a fast actuator, able to achieve tight control on the 
primary variable measured by the sensor. However, it is either limited in 
amplitude or it is too costly in terms of efficiency for long-term control at 
high deviations: as fast, powerful actuators are expensive, cascade control 
can solve some practical problems with two cheaper actuators (one slow but 
powerful, another fast but with limited amplitude). 




Figure 5.6. Cascade control with 2 actuators and 1 sensor 



The cascade controller structure allows a fast disturbance rejection due to 
the fast actuator with a gradual return of it to a desired “actuator set-point” 
when the slower one takes charge. 
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Figure 5.7. Heat exchanger 



Example 5.12. A typical example is a heat exchanger with a valve V s regulating 
steam flow, whose primary reference is outflow temperature (Figure 5.7). It has a 
high-order, slow dynamics (time constant of about several minutes plus maybe a 
significant delay). Let us assume that experimental modelling fits a model such as: 

r ( a \ - 60 

Gl( ) (120s + 1) 4 

where output units are degrees Celsius and input units are valve opening [—0.5, +0.5] 
around a nominal 50% set-point. 

From the Bode diagram, for target time constants below 120 s, achieving a 
tenfold increase in speed would require a control effort roughly 10 4 times that of 
the step response. Achieving that control bandwidth is impossible in practical terms 
whichever control design methodology is used (a 10 4 times more powerful actuator 
cannot even be considered). However, the DC gain is reasonable in the sense that 
operating the valve can cause temperature variations of ±30 units, and this is deemed 
enough for compensating for the expected disturbances. 

A bypass valve VJ, (in a pipe having a reasonably small section), on the contrary, 
has a fast action (a time constant of seconds), such as, roughly: 

30(0. 2s + 1) 

Ga(s) = (7+i) 

and, furthermore, the smaller valve can be operated with more precision. However, 
it can only compensate temperature variations of ±15 units, and operating it at 
wide apertures is inefficient (as the exchanger is heating fluid only to mix it with 
cool water afterwards). 

A cascade controller will successfully combine the advantages of each of the 
actuators. The bypass valve will be in charge of the fast dynamics (quickly cancelling 
disturbances or achieving set-point changes with controller Rl) and a slow loop ( R'2 ) 
will drive the bypass valve to a reasonably efficient operating point at 50% opening 
of valve V s , for example, by adjusting the steam valve. As there exists an additional 
actuator (the main inflow valve Vo) the proposed cascade structure may be used as 
a part of a multi-loop control strategy, if so wished, to follow temperature and an 
additional flow rate set-points (although some coupling does occur between flow and 
temperature). Combined strategies are discussed in Section 5.6.1. 
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5.5 Other Possibilities 

Several additional alternatives (and combinations of them) are widely used 
in industrial multivariable control structures. Some of these will be briefly 
outlined. 

5.5.1 Indirect and Inferential Control 

Indirect control refers to controlling a set of variables, z, by controlling other 
secondary ones, y, with best dynamic characteristics and/or cheaper sensors. 
Set-points for the secondary variables are obtained by means of a suitable 
model relating y with the primary variables z, for which control objectives 
are fixed. 

Of course, the viability of the indirect approach will depend on the quality 
of the model and the influence on it of unmeasurable disturbances and plant 
variations. 

Indeed, indirect control is implicitly used in practically all control systems, 
as the controller is trying to regulate the electrical signals coming from the 
sensors, on the basis that they are closely and disturbance-free related with 
the actual plant outputs. However, by realising that fact, the control designer 
can use the same idea in more general situations. Figure 5.8 depicts the set-up. 




Figure 5.8. Indirect control: use y to control 2 



If a model is available, some tests [119] can be carried out to determine if 
y is a good indirect measurement to control 2 . Let us express the open-loop 
equations as: 



y = Gu + G d d (5.28) 

z = G z u + G zd d (5.29) 

where d is an unmeasurable disturbance vector. If a desired z r should be 
achieved, the ideal control action would be u* = G~ l (z r — G zd d) . Substituting 
into the first equation, one gets as an ideal target output: 

y* = GG-'zr + (G d - GG-'G^d (5.30) 

However, as d is unmeasurable, the set-point should be y r = GG~ 1 z r and 
G* d = G d — GG~ l G zd should be small enough (evidently, this is not needed 
for the measurable components in d, if any). 
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Furthermore, the controller may not perfectly follow the above set-point y r , 
due to disturbances, modelling errors, stationary errors, measurement noise, 
etc. So, the output y should also be chosen in such a way that the loop error, 
e = y r — y, does not have an important effect on the achieved z. In particular, 
if the achieved y were y = y r — e, the control action would be, by (5.28), 
u = G~ 1 (GG~ 1 z r — e — Gdd), so, replacing it in (5.29), the resulting deviation 
on the achieved z would be: 

z-zr = (G zd - G z G~ l G d )d - G z G~ 1 e = -G z G-\e + G* d d) (5.31) 

So, indirect control will be successful if both control error in y is small and 
G z G~ 1 G d = G z G~ 1 G d — G zd is small enough in the frequency ranges of 
interest 8 . Different choices of measurements will lead to different achievable 
loop precision (e) and disturbance effects (G d ). 

Example 5.13. A controlled variable z — u + d is in itself inaccessible, and two 
candidate measurements y\ = 6u + 2d + p, j /2 = u + l.ld + q must be evaluated for 
indirect control. Disturbance d has an expected worst-case size of 1 unit, p and q 
are other perturbations, sensor non-linearities and measurement noise. Experience 
of the control designer assesses that controlling 1/1 would achieve an error of about 5 
units, and controlling 1/2 the loop error would be about 3 units. Evaluating G Z G _1 
yields 1/6 and 1 respectively, and G* d yields —4 and +0.1. Hence, the worst case 
error in z may, approximately, be calculated as: e z i « —1/6 *(5 + 4*1) = 1.3 and 
e Z 2 s=s 1 * (3 + 0.1 * 1) = 3.1. Hence, measurement y\ seems a better choice. 

A variation of the idea is the so-called inferential control [123], where 
measurements of y and the model are used to reconstruct an estimation of z 
as sensor input to the regulators. So, in Figure 5.8 after measurement of y, a 
block with equation z = G z G~ 1 y is inserted and a regulator is designed for 
the G z subsystem, with no set-point transformation. Note that in this case, 
the correction is inside the feedback loop, contrary to the indirect control 
framework, where the correction is applied to the set-point in a feedforward 
operation. 

In many cases in practice, the availability of these transfer functions is 
difficult. Most cases of indirect control are decided on the basis of engineering 
common sense and estimates of the DC gain values of G Z G~ X and G z G~ 1 G d — 
G zd . 

Remark 5.14- If the DC gain characteristics of G, G z , G dd or G zd are not cor- 
rectly estimated, there will be a DC offset on the indirectly controlled vari- 
able z. Zero steady-state on that variable is possible if it is measured, perhaps 
infrequently, and the deviations are used to correct the set-point of the mea- 
sured variable. Indeed, this is the case in many composition measurements in 
chemical processes, where on-line control is carried out on an easily available 
physical property (light absorption, conductivity, density) and its set-point is 

8 G Z G -1 will not usually be “small”: for example, an ideal case would have G — G z . 
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updated based on more precise product analysis (taken with an interval of min- 
utes to hours) in a sort of outer integral-action loop (perhaps manual). Gen- 
eralisation of these ideas gives rise to the so-called non-conventional-sampling 
control (Section 9.4). 

Example 5.15. Indirectly controlling the concentration of a particular compound 
or microorganism via measurement (and feedback control) of light absorption in a 
particular spectrum is common practice in some chemical, pharmaceutical and food 
industries. This strategy needs careful calibration of the sensors so that a (in most 
cases, non-linear) static function relating absorbances and concentrations can be 
used to set absorbance set-points. However, that model may be affected by distur- 
bances such as ambient temperature (affecting the photodetector sensitivity), accu- 
mulation of dirt on the pipes, impurities, etc. so either a cleaning and maintenance 
schedule or a re-calibration one should be carefully followed. 

Example 5.16. A flash separator heats light hydrocarbons (mainly methane, ethane, 
butane plus three other components), lowers the pressure and separates liquid and 
vapour phases inside a vessel, and the primary controlled variable is the ethane 
concentration in the product liquid phase. 

The product composition is a function of the feed composition, pressure and 
temperature in the vessel. If on-line analysis of ethane concentration is discarded, 
temperature and pressure set-points are calculated based on suitable liquid-vapour 
thermodynamic tables. 

To assess the validity of, for example, temperature (assuming good control on 
pressure) as an “inferential” variable, experiments or calculations are carried out to 
determine, at least at steady-state: 

1. How temperature variations relate to composition variations. This, multiplied by 
the expected temperature loop error, will indicate composition errors (G z G~ 1 e). 

2. How expected variations in feed composition (d) would influence the desired 
temperature set-point ( G* d = G d — GG~ 1 G zl j). 

If any of these quantities is deemed excessive for a desired ethane concentration 
precision, there would be a need for an on-stream analyser. Matrix (singular value) 
analysis would be required if both temperature and pressure errors were considered. 

Anyway, the temperature set-point must be corrected to achieve zero ethane 
concentration offset. This can be done either manually by an operator, after results 
from laboratory analysis, or automatically if a downstream analyser (operating at a 
lower latency than the control loop due, for example, to delays or to being a shared 
sensor also used in distillation control) is used. 

These ideas are closely tied to the problem of secondary sensor and actuator 
selection for achieving primary objectives, being relevant even in the project 
phase. 



5.5.2 Override, Selectors 

In some situations there are several outputs to be controlled with only one 
available actuator. Of course, there is the option of controlling, in a SISO 
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set-up, a weighted sum of them or any other combination, but in many cases 
the control objectives on these outputs can be “prioritised” in some way. 

A typical example of this case is given by a combination of performance 
and fault-tolerance objectives. For example, a central heating system where 
not only is a particular water temperature desired as a primary reference but 
also the requirement to keep pressure under a maximum safe value. 

These issues are dealt with by using selector blocks in the control structure, 
usually carrying out maximum and minimum operations on a set of signals. 
There are two basic configurations: 

• Output selectors. The sensor to the control loop is the maximum or min- 
imum of a set of similar variables (able to be controlled with the same 
regulator) . 

For example, this would be the case in a fired heater if a main heating 
power input, u, is used to keep the maximum temperature of a set of 
sensors at a prescribed value. This block is sometimes named as the “ auc- 
tioneer selector'" . 

• Input selectors. In this configuration, several controllers compute a control 
action value for individual sensors and set-points. Afterwards, the selector 
chooses the minimum or maximum value to be actually applied to the plant 
via a single actuator. This configuration is usually denoted as override 
selector. 

An example of this case is using the heat input, u, attached to a temper- 
ature loop in normal conditions except when the pressure is too large and 
a pressure controller outputs a lower heating power command, overriding 
the temperature controller. In this case, the selector would carry out a 
minimum operation. Similar situations arise, for example, in mixing tanks 
with a primary concentration reference and an override level control for 
tolerance to unexpected disturbances or faults, to avoid tank overflow. 

Override selectors are indeed a common configuration in complex plants 
with strong safety requirements. In fact, most control systems incorporate 
operator override (manual control) for direct actuation under unexpected cir- 
cumstances. The issue of automatic/manual bumpless transfer is further dis- 
cussed in Section 9.3. 

Although these issues have been discussed in the framework of decen- 
tralised control, the control engineer may need to enforce these requirements 
also into centralised control subsystems. 



5.5.3 Split-range Control 

In some cases, actuator constraints or non-linearity make it necessary to add 
an extra input. These configurations are denoted as split-range control. In this 
case, the selectors act as logic-switches, carrying out other operations than the 
minimum and maximum previously discussed. 
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For example, amplitude constraints can be overcome by using an extra 
second actuator if the control command is above a particular limit (if the use 
of two individual actuators is justified with respect to the use of a single but 
more powerful unit in terms of achieved precision and price). 

Other non-linearities apart from saturation may force the use of split-range 
actuators or sensors: 

• different sensors may be advisable for measuring a particular variable with 
improved precision in different operating regimes. This would also be the 
case if the linearised state space model becomes weakly observable for a 
particular sensor configuration, C, in a certain operating point but an 
alternative C is available. 

• different actuators may be needed in different operating regimes. For ex- 
ample, if a particular configuration of manipulated variables B on the lin- 
earised model yields a nearly uncontrollable system (and different actuator 
locations or physical phenomena B' can provide a more efficient strategy) . 
Also, precision of the actuator at different power levels can drive towards 
this kind of decision. 

The implementation of this scheme can be based on ON/OFF switching be- 
tween different sensors, actuators and controllers or interpolated in a more 
smooth way in a gain-scheduling framework (see Section 9.5.2). 

The most straightforward and widely used example of this strategy is the 
use of different actuators for lreating/cooling in temperature control systems, 
but the idea may apply to other kinds of processes. 

5.5.4 Gradual Control, Local Feedback 

In some kind of manufacturing processes, several processing stages can be set 
up to gradually improve specifications over the same variable, using actuators 
with different power and precision and sensors with different precision and 
range. 

Example 5.17. Neutralising a significant flow of liquid with precision is not easy. 
A first neutralisation mixing tank may achieve a pH in the interval (5. 5, 8. 5) for its 
outflow product (coarse control), and then a second stage with smaller pipes and 
more precise valves could achieve a final pH in the range (6. 5, 7. 5). This could be 
a solution with cost advantages with respect to a unique neutralisation stage with 
high flow rate, high-precision valves. 

The issue in this case is, of course, the trade-off between the performance 
improvement against the cost of the extra equipment. 



5.6 Sequential— Hierarchical Design and Tuning 

In cascade and some multi-loop structures, loops are designed sequentially, 
giving rise to hierarchical control designs. 
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First, a lower-layer (local, inner) control system is designed for controlling 
a set of outputs, t/ 2 - Next, with this inner control in place, the design is 
continued to achieve control of other outputs, y \ . Table 5.1 summarises some 
of the previously discussed possibilities (t /2 is assumed to be measured) [119]. 



Table 5.1. Summary of decentralised alternatives. Primary variables (yi, with con- 
trol objectives), secondary variables ( y 2 , always measured) 





Measurement of yi Control objectives for 3/2 


Sequential multi-loop control 


Yes 


Yes 


Cascade control 


Yes 


No 


Partial control 


No 


Yes 


Indirect Control 


No 


No 



Some simplifying assumptions in hierarchical decompositions are usually 
made: 

• use simple regulators for the inner loop, 

• use longer sampling intervals for master loops (see Section 9.4), 

• use simple models to design the outer loops (assuming the inner loop is in 
control, its deviations from the reference model - the simplest one would 
be a gain - are small, if the inner loop bandwidth is higher than the outer 
one) , 

• use inner loops to stabilise or diminish some particular disturbances on 
internal variables (local disturbance rejection) and leave outer loops to 
open- loop or manual control (true “partial” control), 

• variables in 3/2 and actuators must be chosen so once under good control 
they do not impose unnecessary control limitations (RHP poles and zeros, 
ill-conditioning) on the remaining problem. 

The considerations here have been restricted to a two-layer set-up but exten- 
sions on similar grounds can be made in a multi-layer hierarchical structure. 

Cascade control. In cascade control, 3/2 usually denotes secondary outputs, 
and yi denotes primary variables for which there is a set-point and whose 
regulators provide set-points for 3/2 • 

Multiloop control (sequential loop closing). In sequential multi-loop 
control, there are control objectives for both sets of variables. 

Of course, if a model is available, sequential loop closing (SLC) method is 
one well-known method for tuning multi-loop control systems for multivari- 
able processes: each controller is designed sequentially with SISO methods by 
finding the transfer function for the paired input and output after former loops 
have been closed [39, 60]. As further loops are closed, the transfer function 
of the previous ones changes, so the tuning sequence must be repeated until 
convergence is reached [60]. 
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Ideally, in a triangular plant, the variables to be first tuned would be those 
not influenced by the rest, and sequentially, the loops on upper variables will 
be closed one by one. If a triangular structure exists, control errors on lower- 
hierarchy loops will affect the current one as disturbances. In a general case, 
as a rule of thumb, faster loops are tuned first 9 . To reduce the effect of later 
loops, in the tuning of the lower ones approximate transfer functions of the 
to-be-closed loops may be included [39] . 

If the system exhibits integral controllability with integrity (ICI), then the 
order in the sequence will not affect the final result for slow target bandwidth. 
In that case, the controllers can be iteratively tuned, even on-line: first, all 
regulators are tuned to slow specifications (low-gain PI) and subsequently, 
specifications are increased in the loops, one at a time, until coupling effects 
start to appear, hindering further improvement. If the system does not exhibit 
integrity, then the order of start-up and tuning of the several loops is indeed 
relevant. 

In a general case, the final performance achieved depends on the se- 
quence of loop closing and the suitability of the selected pairings, and there 
is no integrity guarantee. This will not happen if the plant is approximately 
diagonally-dominant . 

Example 5.18 (2 x 2 tuning.). Based on (5.8), if the bandwidth of loop 1 is much 
faster than that of loop 2, K 2 G 22 will be small at crossover for loop 1. So, CE(s) 
will approximate to 1 + A'lGn if An is not small either. So, the faster loop can be 
closed first, disregarding interaction. 

If loop 1 is much slower, then K 2 G 22 will still be “big” at the loop 1 crossover 
frequency (as, for example, integral controllers have high gain at low frequencies). 
I 11 this case, 

CE(s) » 1 + A'iGii- 1 - 
A11 

so the slower loop must be designed taking into account the change of dynamics (at 
least, approximating by the gain An(0)) given by closing loop 2. 

Example 5. 1 9. The idea in the above example is implicitly applied in the combined 
multi-loop level and pressure control in the steam boiler case study: strong coupling 
and RHP zeros do not easily allow fast control on both loops, so a decision is made 
aiming for a fast control on the pressure loop and a slow, sluggish loop on the level 
control. See details in Section 5.8.1 on page 159. 



5.6.1 Combined Strategies for Complex Plants 

Note that mixed strategies, incorporating several of the possibilities discussed 
in previous sections, are possible. They are, in fact, necessarily implemented 
in the overall design of a complex control structure. The division on subsys- 
tems and subtasks, jointly with supervision, diagnosis and communications 
constitute the basis of the so-called plant-wide control [46] . 

9 If no model is available, the Ziegler-Nichols ultimate frequency (stability limit 
with proportional control) may be used for ranking. 
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Example 5.20. In the heat exchanger in Example 5.12, if performance needs to be 
improved, a good solution would be to control the two exchanger valves with an ad- 
ditional slave cascade loop, by adding mass-flow sensors, for instance. If the heated 
fluid needs to be stored in an insulated tank, this control system would be a decen- 
tralised subsystem that would control temperature simultaneously with another flow 
control system governing a main valve, in a multi-loop structure. Flow commands 
will come from a master cascade controller carrying out level measurements in a 
downstream tank. 

In a general situation, for a complex production facility, these subsystems are also 
a slave cascade control of other chemical process that requires different temperatures 
of a fluid to compensate for purity/flow/temperature variations of other materials 
in a downstream reactor. 

The expansion is endless, and a whole plant can be controlled with multiloop 
+ cascade -I- decoupling structures given the sufficient amount of sensors and 
actuators is available. This is, in fact, the de facto way of designing control 
systems in process industry, and only some subsystems (if any) are “upgraded” 
to predictive control or other (robust-control) centralised techniques. 

Example 5.21. A typical boiling water reactor nuclear power plant has a large num- 
ber of sensors (operators like to be informed about what is happening), and the 
operators in the control room are the “masters” of about a dozen “key” loops that 
themselves are masters of more than 120 “important” regulators controlling flows, 
temperatures, voltages, flow levels, etc. embedded into multi-loop, cascade and feed- 
forward structures, conformed into several main subsystems: nuclear reaction con- 
trol, steam quality control, control of output electrical magnitudes, etc. Operators 
are also in charge of multitude of diagnostic and supervision tasks, of course. A 
wise design on the plant-wide level enables coordination of hundreds of elementary 
regulatory loops towards the overall objectives. 



5.7 Key Conclusions 

In this chapter, the control of systems with multiple inputs and outputs is 
discussed using SISO-based tools, either directly (such as in multi-loop or 
cascade control) or after some multivariable decoupling transformation. 

Multi-loop strategies, if suitable, may present the advantages of integrity 
(fault tolerance), as well as striking simplicity. However, in some cases, tuning 
may be difficult and coupling may severely limit their performance. 

Decoupling is based on mathematical transformations of the system mod- 
els into diagonal form. Feedforward decoupling can be used in many cases. 
Feedback decoupling achieves its objective if state is measurable and system 
is minimum-phase. However, decoupling may be very sensitive to modelling 
errors and it is not the optimal strategy for disturbance rejection tasks. 

Cascade control is widely used in industry to improve the behaviour of 
basic SISO loops via the addition of extra sensors and actuators. However, 
ease of tuning requires that different time constants are involved in different 
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subsystems. In general, addition of extra sensors and actuators in a SISO 
or MIMO loop, even if no primary set-point needs to be fixed in principle 
for them, will improve achievable performance and/or tolerance to modelling 
errors (see Chapter 8). The level of improvement must be traded off against 
the cost of additional instrumentation. 

Combining the above strategies, plus override selectors, split-range etc. is 
usually required in most real-world, industrial-scale projects. Division in sub- 
systems with independent control for them is key to the success of a large-scale 
design. Each subsystem can itself be controlled in a decentralised or a cen- 
tralised way, depending on the suitability of the above techniques and the 
availability /price of the instrumentation. 



5.8 Case Studies 

In this section, some case studies on the topics of the chapter will be presented. 
The interested reader can find further control-structure selection case studies 
in, for example, [119, 126, 38, 129, 105], mostly in the chemical engineering 
framework. Feedback decoupling is illustrated in the case study in Section 6.5. 

5.8.1 Steam Boiler 

A case study on a decentralised control structure for a steam boiler will now be 
discussed. The implemented structure combines multi-loop, cascade, override 
and ratio control set-ups. 

Steam has been, over two centuries, the most widely used heat transport 
fluid. It is used for power generation and process operations. Power gener- 
ation requires lrigh-temperature, superheated steam for optimum efficiency. 
Process applications require lower steam temperature, closer to saturation. 
If several steam characteristics are needed from a single boiler, downstream 
superheating/desuperheating stations may be needed. 




Figure 5.9. Process to be controlled 
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In industry, control instrumentation in boilers must provide efficient, reli- 
able and safe operation for long periods of time. A possible schematic repre- 
sentation of a typical steam boiler is depicted in Figure 5.9. The objective is to 
design a low-cost control system ensuring suitable quality (temperature and 
pressure) of the produced steam, with the basic energy source of a propane or 
fuel burner to bring to boil the water inside the main vessel. A recirculation 
pump is used to achieve higher lreat-transfer constants. More complex systems 
can have several take-off lines operating at different pressures. 

The control system must act in open or closed loop on a series of pumps and 
valves to attenuate the effect of perturbations caused by changing demands 
on the outflow steam characteristics (mass flow, set-point temperatures, pres- 
sures) and changes in fuel composition or pressure, etc. 

Preliminary study. A detailed analysis of drum boiler dynamics and models 
is made in [18]. Some basic ideas will be discussed below, mainly from the 
referred source. 

The burner provides the heating power to heat the drum boiler. The mass 
and thermal capacity of the metallic elements is indeed comparable (even 
bigger) to that of the water stored in the vessel (typically from one to four 
times). Some low-order models can be devised under reasonable engineering 
assumptions with satisfactory results [18, 19]. More detailed models exist, 
based in finite-element heat transfer equations. 

Pursuing a model-based approach will require a significant cost in the 
modelling and experimental parameter identification phases: a MIMO model 
with second- or third-order temperature dynamics, plus valve dynamics, non- 
linearities, radiation, level dynamics (complex, non-minimum-phase due to 
the steam bubbles inside the liquid phase) etc. make a hard task in achieving 
a faithful model from first-principle knowledge. 

Of course, a model-based design could be pursued anyway and, indeed, 
even with the decentralised PID-like controller to be designed, extensive sim- 
ulation studies with a good non-linear model are advantageous, if possible, 
before actual implementation. However, the decentralised structure design 
will be based on the main characteristics and physical insight instead. 

Steam inside the vessel is approximately saturated, as there is liquid-steam 
equilibrium at least in steady-state. The main heat transfer phenomenon is 
the use of the heating power to supply the needed latent vaporisation heat 
to transform liquid into steam, and also to store energy in the form of gas 
pressure and temperature. The expansion after the outflow valve yields a su- 
perheated steam so a certain amount of energy loss during steam transport 
can be tolerated without condensate deposits on horizontal pipe segments; 
these are able to cause significant perturbations and damage to the instal- 
lation. Condensate in steam lines and cavitation in condensate liquid return 
lines require a careful piping design. 

Besides issues relating to outflow steam quality, there are safety-related 
specifications regarding allowable pressures and liquid level inside the boiler 
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vessel. The reasons for pressure limits are clear. Regarding level control, a 
too-high level may drag liquid into the outgoing stream line, and a too-low 
one may cause overheating of some boiler parts. Some studies (see [18] for 
reference) report that 30% of the emergency shutdowns in French pressurised 
water nuclear reactors are caused by poor level control. 

Selection of Variables to Control 

In the boiler in Figure 5.9 there are several possible sensors: outflow pressure 
and temperature, vessel pressure and temperature, liquid level, mass inflow 
and outflow, etc. Actuators are a set of valves and pumps regarding air, fuel 
and cold water feed, recirculation pumps, output steam line, etc. The problem 
of sensor selection will be discussed simultaneously to the selection of the 
control structure, as the regulators used will be mainly SISO ones. Different 
sensors and actuators could be needed depending on precision and efficiency 
requirements. 

In practice, besides choosing which variables to measure and manipulate, a 
specific manufacturer should be chosen based on its reported instruments char- 
acteristics: price and linearity, calibration requirements, bandwidth, physical 
operating principle, reliability and maintenance, operating range, and possi- 
bilities of on-line signal processing, communications and self-test for faults. 

Main Steam Control Set-up 

The basic structure will be based on a multi-loop approach, depicted in Figure 
5.10, on the following pairings: 

• outflow pressure loop: outflow stream pressure, governing the outflow 
valve, 

• level loop: level sensor, governing inflow valve (see below for details), 

• heat loop: outflow enthalpy (from one or several candidate readings of 
mass flow, pressure and temperature), governing heating power command. 




Figure 5.10. Basic multi-loop control structure 
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The basic structure has been selected, among other possibilities, on the basis 
of physical insight as no model is available: we are “forced” to pair the outflow 
pressure to its valve for a quick response and, then, level to liquid inflow. Note, 
however, that pressure and temperature are expected to be significantly cou- 
pled ( P-V-T relationships in steam equations), and level will also be deeply 
influenced by pressure changes (see below) . The structure needs to be further 
refined, as discussed next. 

Heat Loop 

If outgoing steam pressure is controlled by the output valve, a fully decen- 
tralised approach would only need a temperature or outgoing steam mass-flow 
reading to govern heat power command towards the combustion subsystem 
for successful control. 

To improve performance, however, mass-flow, temperature and pressure 
readings could be combined to calculate an enthalpy balance to produce a 
more correct heat command. This heat command (to the water) should be 
initially overshooted to approximate invert the metallic plant dynamics. 

Of course, a simpler approach using a set of adjustable linear gains to 
approximate the basic idea could be used. For example, in Figure 5.11 a 
combination of temperature and mass-flow reading is used as a candidate 
structure using linear regulators. 

The mass-flow reading is multiplied by the vaporisation latent heat to 
obtain the needed increment of heat power. Dividing by the fuel calorific power 
(joules per burnt kilogram), a conversion to a flow command is achieved. 

A PID temperature controller would try to achieve a reasonable profile for 
desired temperature changes, but it is expected to have a slow response. The 
proposed structure might not be the optimal one. 

Vessel Pressure Control 

As the outflow valve governs outgoing steam pressure, nothing prevents at this 
stage an internal pressure build-up if, for example, downstream machinery is 
disconnected and outflow is suddenly substantially reduced. 

The important safety requirements regarding vessel pressure strongly ad- 
vise the presence of a pressure regulator (with a vessel pressure sensor), which 
will command a reduction of heat power if pressure is above a user-defined safe 
limit. However, it is desired that the controller should not operate if pressure 
is below the limit. 

So, both the steam condition and pressure controllers must be suitably 
combined by means of a minimum selector: the final heat power command to 
the combustion system will be the minimum of that from the pressure loop 
and the one from the outgoing steam temperature (enthalpy) controller. If 
pressure is well below the limit, the pressure loop will command a saturated 
control action, so heating to just achieve the desired steam conditions will be 
selected. 
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Level Control 

The main problem in boiler level control is that the presence of steam bub- 
bles below the liquid level causes shrink-and-swell phenomena. For example, 
addition of cold water produces a momentary lowering of the level reading, 
although, of course, in the long term the water level must increase: the level 
dynamics is non-minimum-phase. 

Changes of internal pressure also affect level, so there is a significant cou- 
pling between those variables: a pressure decrease (opening the outflow valve) 
produces swelling of the bubbles, yielding rising level readings. However, as 
liquid is then in an overheated state, the steam production rate quickly in- 
creases, so in the long term, the level diminishes if no control is applied. 

Due to the coupling and non-minimum-phase behaviour, plus the non- 
linearities from valves and steam tables, the specifications that can be obtained 
in practice are very poor indeed, further worsened by the high amount of noise 
present in sensor readings (caused, again, by the bubbles and turbulence). 

Noise forbids derivative action, and non-minimum-phase limits bandwidth. 
A common choice is a low-gain feedback PI controller. Any improvement would 
need a substantial modelling effort, non-linearity cancellation, etc. and will 
also meet with the noise and non-minimum-phase fundamental limitations 
(see Sections 8.3.1 and 8.3.2) so the model-based approach will not, in many 
cases, significantly improve the achieved results in practice. 

To, at least, overcome cold water feed valve non-linearity, a cascade con- 
troller can be used (so the level controller provides a master inflow reference) 
if a flow sensor is placed at the input pipe. 

However, in this way, disturbances are poorly cancelled. As level control is 
usually carried out mainly for safety reasons, level specifications are not strict 
and significant transient deviations are allowed. 

To improve overall performance, requiring lower PI gains, a 2-DoF struc- 
ture may be used, by adding a feedforward control measuring output steam 
mass flow, and directly incrementing the inflow reference to the cascade regu- 
lator by the same amount. In this way, disturbances are cancelled in the long 
term with very low feedback gains. 

With the presented “final” configuration, depicted in Figure 5.11, the fast 
shrink-and-swell dynamics is intentionally, not controlled (anyway, even if it 
were modelled, the actuator bandwidths might not be enough). 

Control of the Combustion Subsystem 

The combustion subsystem will implement a common structure usually de- 
noted as ratio control. The objective is to control both the fuel flow and the 
air-fuel ratio. Similar ratio-control situations arise in mixing processes (such 
as addition of colourants or reactives). 

In the boiler case, the characteristics of the produced steam will in principle 
point out the need to increase or decrease fuel flow. 
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The optimal air-fuel ratio can be calculated from stequiometric calcula- 
tions. For example, for every litre of propane, 5 litres of oxygen (25 of air) 
are needed for perfect combustion. However, as the mixing and combustion 
processes are not ideal, the desired air-fuel ratio is slightly incremented to di- 
minish the percentage of unburnt combustible feed and increasing efficiency. 
If the air-fuel ratio is excessive, however, the combustion is inefficient as well, 
as the temperature achieved will be lower and part of the heating power is 
being used to heat air that will be discarded on the exhaust outlets (unless 
some kind of hot-air management is set up for energy saving) . 

The maximum efficiency point is thus determined by striking a balance 
between the percentage of unburnt products and the percentage of energy not 
transferred to the vessel. In fuel burners, unburnt components also produce 
significant soot depositions. 

The fuel subsystem could be designed on the basis of one sensor (temper- 
ature or pressure of the steam in some location) and two actuators (airflow, 
fuel flow). However, that would have two significant drawbacks: 

• the efficiency will not be guaranteed in “closed loop” as there is no mea- 
surement of the combustion parameters. As in large-scale installations, 
fuel properties (mainly in oil or coal burners) vary significantly, so does 
the maximum efficiency ratio. 

• The effect of disturbances on the fuel subsystem (regarding air and fuel 
temperature, pressure and composition) would be apparent only when, 
after a significant delay, they affect the steam characteristics. In that way, 
they will be difficult to compensate for. 

So, based on these considerations, results improve significantly if additional 
sensors on the fuel subsystem are put into operation. Control structures that 
handle them will be: 

• cascade control: steam quality will determine the heat power needed (di- 
rectly translated into fuel flow), and subordinate regulators will determine 
the rest of the combustion subsystem actions. In particular, a fuel flow 
sensor will be used for cascade control in the fuel valve, 

• Ratio control: the achieved fuel flow (sensor reading) will entail, given a 
pre-fixed ratio, following an airflow reference by a subordinate cascade 
controller using an inlet airflow sensor. 

If efficiency is a concern, as fuel characteristics produce significant varia- 
tions on the optimal air-fuel ratio, an additional oxygen sensor may be put in 
place: efficient combustion implies that the burnt air should contain around 
4-5% oxygen left 10 . So, the ratio reference (and, subsequently, the air inflow 
set-point) is increased or decreased in closed loop based on the oxygen read- 
ing. As an alternative, a sensor for carbon monoxide (CO) can be set up to 
serve essentially the same purpose. 

10 Ideally, it should be zero, but inefficient mixing produces significant soot and 
carbon monoxide if exhaust oxygen is below the above stated rate. 
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As a cheaper variation, an exhaust gas temperature sensor could serve 
determining the correct combustion point. However, as its set-point is deter- 
mined by the inlet air temperature and humidity, and also depends on fuel 
composition, its capability for improving combustion efficiency is quite lim- 
ited, but it could marginally improve rejection of some disturbances. A similar 
function to the oxygen sensor could be achieved by an smoke opacity sensor 
(opacity increases with the amount of soot and unburnt compounds). Insert- 
ing several of these sensors will help in detecting faults on the system (see 
Section 9.6). 

So, to achieve a heat power command from a hierarchically higher main 
control loop, a moderately sophisticated combustion control subsystem uses 
two flow sensors (air, fuel), two servovalves (air, fuel), and one oxygen or 
carbon monoxide sensor on exhaust gases, in a mixed cascade and ratio-control 
setup. 

Other Subsystems and Conclusions 

Large-scale boilers have additional subsystems to be controlled, further com- 
plicating the overall control structure. These subsystems are, for instance: 

• fuel pre-processing in oil burners. Variations in fuel viscosity, humidity, 
etc. may need to set up a control system for: 

pressure in the fuel supply line, 

fuel temperature, using the residual heat of the exhaust gases, 
water/fuel ratio (mixing and emulsion control). Addition of a small 
quantity of water makes viscosity and the spraying and atomisation 
characteristics uniform (better flame quality), 

• feed water treatment, in two lines: 

to avoid impurities that, deposited on the exchanger pipes, will dimin- 
ish heat transfer rate, causing overheating and deformations on metallic 
components. Obstructions due to impurities may entail damage to the 
system and safety risk for operators. The treatment is carried out by 
filtering and monitoring water resistance to divert water, if needed, to 
decalcification or demineralisation units, 

pre-heating the incoming water causes much lower disturbances on the 
level loops, so a further temperature control can be put in place. 

So, to conclude, a decentralised control structure has been proposed based 
on physical insight into the underlying process, using cascade, feedforward, 
feedback and ratio control blocks, to achieve reasonable disturbance rejection 
and robustness as well as minimum selectors on heat power for safety. The 
overall control system is depicted in Figure 5.11. 

The final design uses: 

• eight sensors: (outgoing steam temperature, pressure and mass flow), oxy- 
gen in exhaust gas, flow sensors for air, fuel and feed-in liquid water and 
a vessel pressure sensor, 
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Figure 5.11. Proposed control structure 



• four actuators: valves or pumps governing fuel, steam, liquid and air flows. 

Further sensors in the additional subsystems could be needed for large- 
scale plants. Furthermore, additional sensors such as temperature of critical 
metallic parts or exhaust gas, etc. could be installed for safety and monitoring 
reasons or to further refine the control structure. Reliability issues would also 
advise incorporation of redundant sensors or actuators. 

A wise choice of sensors, actuators and control structure allows easy com- 
prehension of the overall regulation strategies by operators, significant reliabil- 
ity and the use of standard equipment. A centralised regulator (an 8x4 trans- 
fer function matrix) tuned with a methodology such as the ones in Chapters 
6 and 8 would have the proposed structure as a “particular case”. However, 
improving performance with reasonable model error tolerance would require, 
in most cases, a substantial effort. 



5.8.2 Mixing Process 

Now, a pairing selection and decoupling problem will be illustrated for a mix- 
ing process [89]. 

A solvent and a pure component A are mixed in two converging pipes. 
Actuators are a valve on each flow (V s , Va). Outflow q and concentration xa 
sensors are in place (Figure 5.12). 

The basic equations at steady-state, and its linearisation around a desired 
operating point (a: 0 o, qo) are: 
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Figure 5.12. Mixing process 



q =miV s + m 2 V A -, q = m{V s + m 2 V A 

_ m 2 Vg - _ _Xao \r I (l-Xq 0 )Tra 2 T/ - (^O.dZj 

J '° m 1 V,+m 2 Vl’ — 9o ^ 9o ° 

We will assume nn\ = TO 2 = 1. For a first model, dynamics of the valves 
have been neglected, as well as conditions regarding pressure drops {q is a 
non-linear function of the valve openings) . 



Pairing 



If the set-point is at low concentrations of A , then V A to control composition 
and V s for total flow are advisable, as composition varies greatly with the 
amount of flow of pure A. For example x a o = 0.05, qo = 1 leads to a DC gain 
and RGA given by: 



G = 



1 1 
-0.05 0.95 



/ 0.95 0.05 \ 
y 0.05 0.95 ) 



(5.33) 



confirming the intuition. On the other hand, if the set-point is at high concen- 
trations of A, the roles are reversed and now strong influence on composition 
changes is exerted by valve V s - In this case, the gain and RGA matrices are: 



G = 



1 1 
-0.95 0.05 



/ 0.05 0.95 \ 
y 0.95 0.05 ) 



(5.34) 



confirming the suitability of the alternative pairing. If a wide range of set- 
points must be attained, maybe multi-loop control is not the optimum choice. 



Decoupling 

To achieve approximate decoupling at steady-state, the inverse DC gain is 
(with mi = m 2 = 1): 



f Y» \ = ( 1 ~ x ao - qo \ f q \ 

\V A J \ X a0 qo ) \Xa ) 



(5.35) 



So, that is the matrix that should be used to achieve decoupling. Intuitively, 
if flow needs to be increased, both valves must be opened proportionally to 
the composition, to keep it unchanged. If composition needs to be increased, 
V A should be increased and Vs decreased, to keep flow unchanged. 
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If wide set-point variations are expected, two alternatives are possible 11 : 
setting a fixed decoupler for an intermediate point ( x a o ~ 0.5, for example) or 
changing the decoupling matrix as a function of the known operating points. 
In this way, a partially non-linear controller is designed (linear in the sensors, 
non-linear - gain-scheduled, see Section 9.5.2- in set-point processing). 



11 Another alternative is to directly invert the non-linear equations in (5.32). Indeed, 
with Vs = (1 — x a )q and Va = x a q, suitable mixing does occur. This achieves 
decoupling in all operating ranges, but the product is not a linear operation. This 
is an example of straightforward non-linearity cancellation (see Section 9.5). 
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Fundamentals of Centralised Closed-loop 
Control 



In this chapter, some now-classical centralised state and output feedback 
strategies are described, referring to dedicated books for further information. 

Centralised control is implemented via computer code, having as inputs 
all the available sensors and producing signals for all available actuators in 
the system. This is the most powerful strategy, at least in theory, capable 
of extracting “optimal” performance (for some definitions of optimality). In 
practice, however, it requires non-standard equipment (industrial computer, 
data acquisition cards, communications), its tuning is usually non-intuitive 
(involves matrix computations) and in case of a fault the whole system may 
break down. This is one of the reasons why it is not widely used in indus- 
try. However, for complex strongly coupled plants, this one may be the only 
solution with a limited set of actuators and sensors. 

Centralised control can be implemented either in open or closed loop. As 
the open-loop case (set-point tracking) has been considered in previous chap- 
ters, in this chapter emphasis will be placed on the solution of the regulation 
problem. Combined set-point tracking and regulation will be dealt with in 
Section 6.3 (1-DoF configuration) and Chapter 8 (2-DoF configuration). 

Let us analyse the feedback loop using the state space representation, first 
in a simplifying framework and afterwards in a more general case. 



6.1 State Feedback 

The first case to be studied will be the one in which the number of independent 
sensors is equal to the order of the system. This is denoted as state feedback 
or full-information control. The system is described by (2.17): 

x = Ax + Bu (6.1) 



where x is assumed accessible (via n independent sensors so that matrix C 
in y = Cx is invertible) and, without loss of generality, we will assume that 
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C = I. In Section 6.2, other alternatives will be considered, under the name of 
output feedback, when the number of sensors or deficient signal-to-noise ratio 
do not allow for a full-information implementation. 

Linear time-invariant state feedback control is expressed 1 as: 




where v is an additional m x 1 input term to be used, for example, to position 
the system around a nominal set-point where the linearisation is valid (if v is 
a constant v = G(0) _1 r, being r a set-point vector) or to carry out additional 
feedforward control tasks (Section 4.6). 

Remark 6.1. State feedback is the natural generalisation of conventional pro- 
portional and proportional-derivative control for low-order SISO systems. In- 
deed, under particular assumptions (see Section 3.7.5), there is a canonical 
representation where a state vector can be constructed as the reading of a 
certain sensor and its successive derivatives (generalising, for example, the 
position + speed feedback in a 2nd-orcler mechanical system). In many cases, 
a PD u = Kpe + Kpe can be immediately cast as a state feedback law for a 
dominantly second-order process. 

Note that, by sheer definition of state, any state or output derivative can 
be expressed as a (static) function of the present state: the state con- 
tains all past information relevant to the future so a static u = K(x) 
full-information controller has the same capabilities than a dynamic one, 
u = K'(x, x,y,y,x, . . . , ...), as the latter can be cast into a form u = K(x). In 
the linear framework, there is no advantage in further complicating 2 expres- 
sion (6.2). 

Applying the control law, (6.2), to (6.1), the following closed-loop equation 
results: 

x = Ax + B(—Kx + v) = (A — BK)x + Bv (6.3) 

So that, by suitable selection of K , a prescribed set of properties for (6.3) can 
be achieved. Note that disturbances have not been considered at this moment. 

For discrete-time systems, using the same control strategy (6.2), u k = 
— Kxk + Vk, leads to a closed-loop equation: 

Xk + i = Ax k + B(-Kx k + v k ) = (A - BIC)x k + Bv k (6.4) 

1 As usual, negative feedback is assumed. 

2 In an ideal, perturbation-free and model-error free environment. 
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6.1.1 Stabilisation and Pole-placement 

Assuming v = 0, state feedback changes the open-loop initial dynamics, x = 
Ax, into x = (A — BK)x. As stability and settling time are associated with 
the eigenvalues of the system matrix, A c i = A— BK , these characteristics can 
be changed with state feedback control. In fact, the following powerful result 
[11] does hold: 

emphlf a system is fully reachable, the closed-loop eigenvalues can be 
assigned to any arbitrary desired position by appropriately selecting 
K. 

The pole-placement problem consists in assigning all reachable eigenval- 
ues to prescribed values inside the stable region of the complex plane. If the 
unreachable modes of the system already lie there, i.e., the system is stabil- 
isable, this is a stabilisation problem. The prescribed pole positions can be 
used to specify the settling time by means of the approximate expressions in 
Appendix A. 2.1 or, in general, to target a particular closed-loop dynamics. 

This casts in a general framework the design of stable loops with a pre- 
scribed settling time that, for first and second-order SISO loops, can be shown 
to be equivalent to P and PD controllers, respectively. 

There are several methods for accomplishing the pole-placement task. The 
use of canonical forms allows for a simple demonstration, although efficient 
algorithms can be derived and proved for the general case. An example of a 
so-called direct method will now be given. 



Direct Method 

The direct method refers to symbolic calculation of the polynomial: 
det(sl — A c i) = det(sJ — {A — BK)) 

whose zeros are the closed-loop eigenvalues, and calculating the coefficients 
of K so the referred polynomial is identically equal to a desired one. Let us 
illustrate the procedure by means of a couple of examples. 

Example 6.2. Let us have a third-order process, with two inputs, with a normalised 
state-space representation given by matrices 

(1 2 3\ /I 0 

A = 4 5 6; 5= 20 

\7 8 9/ \0 1 

Availability of three sensors for the state variables is also assumed. The desired 
settling time is about 1 second (poles about —3 or —4) so the desired closed-loop 
characteristic polynomial could be (s-t-3)(s + 4) 2 = s 3 + 11s 2 + 40s + 48. The control 
strategy (6.2), written as 
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Mi = —kixi — k 2 X 2 — kzX3 (6-5) 

M 2 = —k4Xi — k*,x 2 — k&X3 (6-6) 



without considering an extra signal, v, will allow a closed loop x = ( A — BK)x whose 
eigenvalues will be the roots of det(s/ — {A — BI \ )) = 0. In this case, 



r = det (si - ( A - BK )) = det 



/ s — (1 — fci) — 2 + k 2 — 3 + fc 3 \ 
—4 + 2k\ s — (5 — 2 fc 2 ) -6 + 2fc 3 
y — 7 + k 4 — 8 + k§ s — (9 — k§) J 



B = s 3 + (he + 2fc 2 + fci — 15) s 2 

+ ((fci — 6 + 2fc 2 )A:6 + (6 — 2103)^5 + (3 — ks)k4 + 23^3 — lOfci — 16fc 2 — 18) s 
+ ( — 3 + 2fc 2 — ki)ke -f- (6 — 2ks)ks + ( — 3 -t- kz)k4 -t- 9A?i -t- 9&3 — 1 8 A 12 

So, ecjuating polynomial coefficients, there are three equations and six unknowns 3 . 
Three of these can be arbitrarily fixed, for example A ?4 = fcs = kg = 0 (deciding not 
to use input 2, quite counter-intuitive indeed and only possible because the system 
is fully reachable by the first control variable, otherwise, this assumption will not 
work). The remaining equations are: 

fci + 2 k 2 - 15 = 11 

— lOfci — 16fc 2 + 23fc 3 — 18 = 40 (6.7) 

9fci — 18fc 2 + 9fc 3 + 0 = 48 



whose resolution results in the controller gains (fci = 9.47, k 2 = 8.26, fc 3 = 12.39). 



Example 6.3. Let us now consider the headbox canonical representation ( Al,Bl ) 
obtained in Example 3.11 on page 75. Due to the special structure of the matrices 
it appears clear that a control law (6.2) with feedback matrix 



_ f fcn fc '12 fc '13 + 0.6065 0 0 

K ~ \ 0.7711 -2.0961 0 fc 24 - 0.2865 k 25 + 1.1467 

leads to the closed-loop system matrix 



A l - I<B l 



0 10 0 0 

0 0 10 0 

— fcll — fcl2 — fcl3 0 0 

0 0 0 0 1 

0 0 0 — k 2 4 — &25 



and the characteristic polynomial is (2 3 + fci 3 2 2 + fci 22 + fcii)( 2 2 -|-fc 252 -l-fc 24 ), showing 
the possibility of straightforward pole assignment. 



It has been shown that, in the general case, there are many solutions to the 
pole assignment problem in MIMO systems. To get a canonical form and use 
the procedure above is rather tedious if carried out manually. Software tools 
can ease the work. 

3 In the SISO case, we would have had only one column in B and three constants 
(fci , k 2 , fc 3 ) so the solution would have been unique. SISO pole-placement has a 
unique solution (if it exists). 
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Example 6. 4- Matlab® code to carry out the symbolic determinant in Example 
6.2 would be: 

a= [1 2 3;4 5 6;7 8 9]; b=[l 0;2 0;0 1]; syms kl k2 k3 k4 k5 k6 s 
k=[kl k2 k3;k4 k5 k6] ; acl=a-b*k; de=det (s*eye (3) -acl) ; 
de2=collect (de , s) 

However, the Matlab® command ‘place’ directly implements the pole-placement 
solution: 

kk=place (a,b , [-3 -4 -4]) 
kk = -1.0000 7.0000 3.0000 

7.0000 8.0000 13.0000 

providing a different feedback gain (same eigenvalues, different eigenvectors) to the 
one in Example 6.2. Obviously, choosing the “best” one depends on geometric con- 
siderations or optimality criteria (Chapter 7). However, they will not be pursued 
any further in this context. The reader is referred to [11] for detailed analysis. 

The importance of the state feedback results in engineering terms is that: 

the more independent sensors are available, the less sophisticated the 
control strategy is for a given desired specification: with enough num- 
ber of sensors, transient specifications can be achieved using several 
“proportional” controllers. 

Discrete controllers. For the DT case, the pole-placement problem is to- 
tally analogous, except that the desired positions for the poles now lie inside 
the unit disk. 

Minimum-time Control 

In DT control, there is an interesting option, at least from a conceptual view- 
point. If the poles are all assigned to the origin, the controlled system can reach 
the equilibrium point in the minimum reaching time, (3.45). These controllers 
are denoted as deadbeat controllers. However, when this strategy is applied 
to a sampled-data controlled system, caution should be taken with the be- 
haviour of the signals in the intersampling period, because hidden oscillations 
may appear. 

Example 6.5. In Example 6.3, for fci 3 = ki 2 = fen = fes = fei = 0 in the feedback 
matrix K, the closed-loop system transfer matrix from v to y is: 

/ - 0.9315 — 0 . 63213 + 0.4923 \ 

M(z) = ( o.§585 0.29081-0.2628 1 

V “PS - p J 

It is worth noting that the CT model response to some initial conditions will not 

reach and stay at the equilibrium in three sampling periods, as the DT model step 
response suggests, and some intersample oscillations will occur. 
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Matlab®: Some commands implementing algorithms related to the contents of this 
section are: place, acker. 



Remark 6.6. Pole assignment strategy implies applying a control signal to 
move the poles from the open-loop positions to the closed-loop ones. In this 
framework, the concept of control effort, related with this pole shifting [3], 
points out the magnitude of the control action to achieving this placement. In 
DT systems, as the control is open loop in between the sampling times, large 
control efforts will warn for unexpected delays and, in any case, CT or DT, 
for model uncertainties. 



6.1.2 State Feedback PI Control 

As already mentioned, the state feedback control law allows us to place the 
reachable poles in any desired position, assuring a closed-loop dynamic be- 
haviour, but nothing is said about the input/output behaviour. In particular, 
in servosystems, a common requirement is to be able to follow changes in 
the references and the classical solution is to introduce the integral action. 
Another option is to apply a feedforward action, to drive the system in the 
desired direction. 

Let us consider the introduction of an integral action based on the track- 
ing error. Assume that the controlled variables are the system output vector 
components, y(t). To achieve zero steady-state error for constant or ramp-like 
disturbances, a number of integrators should be added. For step changes in 
the references, the control action will be: 

u = —Kx — Kj j (y — r) dt (6-8) 

where Kj = 7G(0) _1 , G(0) being the plant’s DC gain and 7 a small scalar 
(or a diagonal matrix in case different “integral gains” are wished for differ- 
ent inputs). This is a straightforward way of generalising SISO PID control. 
However, if Kj is not very small, it may significantly distort the closed-loop 
dynamics. 

Plant augmentation. A wiser alternative is the addition of integrators at 
the process output and then designing a controller for the augmented process: 
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where the additional auxiliary state variables, v act as “accumulated errors’ 
generalising the concept of the basic control action ( Ki f edt). 
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A stabilising controller for the augmented plant must be designed, for 
instance, by pole assignment, as before. But again the interpret ability of the 
result is not clear because we can define a set of closed-loop poles, but not 
to assign them to some specific state variables. There is no simple way, at 
this moment, to specify that the integral action may have a “slow” pole as in 
SISO PID control if the regulator is intended to compensate for very slowly- 
varying drifts. The pole-placement design may assign the slow pole to any of 
the process modes and not to those exclusively associated to e. In the next 
chapter, in the context of Kalman filtering, the idea will be further developed. 



6.2 Output Feedback 

In a general situation, the number of sensors is not necessarily equal to the 
number of state variables, and there is a presence of disturbances (process and 
measurement noise) so that an accurate enough reconstruction of the state by 
numeric derivation is not possible. In this section, a framework to deal with 
closed-loop control in this case will be presented. It is based on a two-step 
procedure: first obtaining an estimation of the plant state and then using this 
estimate in state feedback laws. A fundamental result (separation theorem) 
will show that the combination of these two stages yields a stable closed loop. 

Estimation of the state from a set of output sensors will now be discussed. 
Let us start with the discrete-time implementations. 

Indirect state measurement. The most elemental form of state estimation 
is to set up a state representation where the outputs and some of their incre- 
ments (numerical derivatives) conform the state vector. This requires a fine 
model and sensors allowing the computation of numerical derivatives and/or 
filtering. However, numerical derivation amplifies quantisation errors (due to 
finite word-length) and high-frequency measurement noise effects (see exam- 
ple E.l), as (yk — Vk- 1) is small if sampled at a high frequency, so it is masked 
by noise. 

Subsequent low-pass filtering is usually needed to avoid high-frequency 
actuator activity. As the filter introduces some poles and delays, the dynamics 
of the overall system becomes more complex and hence there is a greater 
risk of instability. Furthermore, filtering introduces delays in the detection of 
disturbances affecting the real unfiltered variables. 

Hence, the approach is usually valid only with enough sensors. For ex- 
ample, assuming that only one derivative can be safely taken 4 , to implement 

4 Taking numerical derivatives of a sensor reading leads to unacceptable measure- 
ment noise amplification when second and further derivatives are calculated. Fur- 
ther derivatives might be taken if the signal-to-noise ratio were very good and 
the desired specifications were slow enough so that the dynamics of noise filters 
are still “fast” compared to that of the closed-loop plant. This situation is rare 
in practice: sometimes even taking just one derivative is impractical. 
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“pure” state feedback, in practice, a number of sensors greater than half the 
order of the system is needed. In essence, constant state feedback from these 
estimates is equivalent to setting up a combination of PD controllers with 
noise-filtering. This is an appealing solution, related to decentralised control 
structures. 

Other model-based solutions will now be presented for the case where the 
number of sensors (or its signal-to-noise ratio) is low, so “tuning” of the low- 
pass filtering is adapted to the process characteristics in a “transparent” way. 
These solutions, however, require a reasonably accurate model. 

State reconstruction. The definition of observability (Section 3.7.2) im- 
plies the ability to compute the process state from a finite amount of past 
measurements, by taking the inverse of the observability matrix. However, 
this calculation may be ill-conditioned (see Appendix B.4.1). Extending the 
dimension of the so- formed observability matrix (3.47) beyond the system or- 
der, stacking C, CA , CA 2 , . . . , CA N , with N > n, an old state at x(k — N) 
can be computed. Conditioning always improves as more information (larger 
N) is gathered. Afterwards, the current state should be computed based on 
the process model, (6.1). This is a sort of “averaging” over a user-defined num- 
ber of past samples, leading to a model-based finite impulse response (FIR) 
filtering. 

The number of past samples for a particular noise amplification depends on 
the sampling time, T (as A itself depends on T for a discrete model). However, 
averaging over a significant number of past samples to filter measurement noise 
increases data corruption by process noise and modelling errors, so there is 
a trade-off. It can be shown that the faster the sampling rate the better 
the estimations are for a particular time interval, NT S , to be averaged, as 
intuitively expected. 

A drawback of the approach is that matrix dimensions increase with the 
number of averaged samples. To take advantage of some of the features above 
without increasing computational load, a recurrent (infinite-memory) estima- 
tor will now be developed. 



6.2.1 Model-based Recurrent Observer 

Let us have a DT system modelled by: 

x k +i = Ax k + Buk\ Vk = Cx k (6.9) 

so that if an initial accurate state estimate, Xk, were available, the next state 
should be: 

Xk+i = Axk + Bu k \ ilk = Cx k (6.10) 

Signal symbols with a hat will denote estimations, and those variables without 
it will denote the trajectories on the actual plant. The pair (A, C) is assumed 
to be observable (Section 3.7.2), otherwise the unobservable states will not 
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affect the output vector so estimating them from output readings would not 
be feasible. 

Note that even if x k is accurate, process noise and modelling errors will 
decrease the reliability of Xk+i unless on-line corrections are made, based 
on incoming measurements. This is the idea behind the so-called observer 
equation: 

x k+ i = Ax k + Bu k + L(y k - y k ) (6.11) 

where y k denotes the current estimation of the output based on the knowledge 
of x k and L is a constant matrix (dimension nxp) usually denoted as observer 
gain whose calculation will be discussed next, weighting the output estimation 
error, e Vk = y k — y k . In fact, y k is our actual information from the process 
and y k is our estimate. Thus, the observer basic equation can be written as: 



Xk+i = Ax k + Bu k + L{y k - Cx k ) (6-12) 

x k+ i = (A- LC)x k + Bu k + Ly k (6.13) 

Subtracting the last equation from (6.9) yields: 

{x k+ i - x k+1 ) = (A - LC)(x k - x k ) (6.14) 

e k+ i = (A-LC)e k (6.15) 



where e k is the state estimation error. By calculating L so that the eigenvalues 
of ( A — LC) lie in a prescribed location inside the unit circle, the designer can 
ensure that an initial estimation error will converge to zero in a prescribed 
time 5 . 




Figure 6.1. Observer structure 



Approximately, the longer the prescribed time is, the less sensitivity to mea- 
surement noise the estimate will have but the sensitivity to process noise will 
be higher. With a perturbed model x k +\ = Ax k + Bu k + v k , y k = Cx k + w k 
where v k is the process noise and w k is the measurement one, Equation (6.15) 
is transformed into: 



efc+i = (A - LC)e k + (I - LC)v k - Lw k (6.16) 

5 The settling time associated with the dynamics of these observer poles is, approx- 
imately, an indication of the number of past samples that the observer averages 
to obtain the current estimate, to compare with the previously described non- 
recurrent approach. 
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Remark 6. 1. Note that the lowest effect of measurement noise is achieved with 
L = 0 (open-loop estimation, error dynamics given by (A — 0 * C) = A) and, 
ideally, the lowest effect of process noise is achieved with L = AC , i.e., 
full state measurement (error dynamics A — AC -1 *(7 = 0 with poles at the 
origin 6 ). In this case, the observer would be better considered as a state filter, 
as all the state variables are available. 

In practice, an intermediate set-up would be used. The designer would decide 
the position of the poles depending on the ratio between process noise and 
measurement noise, and the number of sensors. Under certain assumptions, an 
“optimal” observer can be constructed (see Section 7.2). Usually, a reasonable 
settling time for tuning the observer poles could be in the range 33-66% of the 
target closed- loop settling time (when a controller is finally put into effect), 
assuming it is “reasonably” decided considering the magnitude of modelling 
errors and sensor signal-to-noise ratios. 

The observer general layout is depicted in Figure 6.1. 

Remark 6.8. Note that there is a duality between the pole assignment prob- 
lems in control and estimation. In the first case, (6.3), we looked for the matrix 
K to place the eigenvalues of A — BI\. Now, L should be computed to place 
the eigenvalues of A — LC, (6.15). As the eigenvalues of a matrix and its 
transpose are the same, the second problem is equivalent to computing L to 
assign the poles of {A — LC) T = A T — C T L T . 

Example 6.9. Observer design in Matlab® is carried out with: 

L=place(A’ ,C’ ,p) ;L=L’ 

Transposition is carried out as Matlab® places the eigenvalues of A — BK where 
the unknown K is at the right-hand side. 

Continuous-time observers. In the CT case, for a model 

x = Ax + bu\ y = Cx (6-17) 

an observer equation such as: 

x = Ax + Bu + L(y — y); y = Cx (6.18) 

leads to x = Ax + Bu + L(Cx — Cx). So, as before, subtracting from (6.17) 

— (x — x) = A(x — x) — LC(x — x) 

and the state estimation error dynamics is given by: 

6 The observer such that the eigenvalues of A — LC are at the origin is called the 
minimum-time observer : it is the best one for detecting sudden perturbations 
in process state, at the expense of high measurement noise amplification if the 
sampling period is small. 
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- = (A-LC)e (6.19) 

so that assigning the eigenvalues of A — LC in the location specified by the 
designer can be used as a criteria to obtain a suitable value for the gain matrix 

L. 



Matlab®: Some commands implementing algorithms related to the contents of this 
section are: place, estim, destim. 



6.2.2 Current Observer 

In the basic setting, the output estimation error, e Vk , is used to correct the 
next state estimation, x k + i, (6.11). In order to improve the current state 
estimate, using the current output measurement, the following strategy can 
be used: 

Using the predicted value of the output, the observer equation, (6.11), is 
written as: 

x k +i = Ax k + Bu k + L(y k +i - y k +i\k) (6.20) 

where y k + lift denotes the estimation of y k +\ with the information available 
before measuring it, i.e., with knowledge of x k and input u k , based on the 
process model: 

y k+ i\ k = C(Ax k + Bu k ) 

So, operating as before, the final observer equation is: 

{x k+1 - x k+ i) = A(x k - x k ) - LCA(x - x) (6-21) 

e k +i = (A — LCA)e k (6.22) 

An alternative, conceptually different but leading to exactly the same re- 
sult, is to predict the current state, x k \ k _i = Ax k -\\k-i + Bu k - 1 , and then 
update it with the measurement error, x k \ k = x k \ k -i + L(y k — Cx k \ k _i). Op- 
erating on these expressions, (6.22) is also obtained, taking x k \ k as x k . 

Remark 6.10. For pole-placement, the computation algorithm requires the ob- 
servability of the pair (A, C), in the basic setting, but in the current observer, 
the observability of the pair (A, CA) is needed. 

6.2.3 Reduced-order Observer 

It may be argued that some state variables are directly measured and thus 
they do not need to be estimated. Nevertheless, as previously mentioned, even 
in the case of full state measurement, the estimator may be also considered as 
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a measurement-noise filter in such a way that better information can be used 
for control purposes. 

If the measurement noise is not relevant and there is a limitation on com- 
puting resources, a reduced-order observer can be pursued. To better follow 
the reduced-order observer design, let us take a similarity transformation T, 
(2.15), to have the output as the first part of the state vector, completing it 
with any F( n _ m )x n matrix so T is invertible and applying (2.20): 



T = ypj ; A = TAT~ l - B = TB ; C = CT ^ 
leading, in the CT case, to the equations 
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(6.23) 



Thus, we must get an estimate of X 2 , based on the subsystem equation: 



X2 = A22X2 + A21X1 + B 2 u = A22X2 + A 2 iy + B 2 u (6.24) 



The information about this subsystem that we can indirectly measure, as 
provided by the first subsystem equation, is: 

y 2 = A 12 X 2 = Si - A X \X\ - B x u = y - Any - B x u (6.25) 

where i /2 = ^4.12^2 is a fictitious output that can be “measured” to be used in 
an observer equation (6.18) for (6.24): 

X 2 = ^ 222:2 + (A 21 B 2 ) + -^($2 ^ A 12 X 2 ) (6.26) 

So, replacing i /2 by its value in (6.25): 

W 2 = (A 22 - LA 12 ) x 2 + (B 2 - LB X ) u + (A 2 i - LA X1 ) y + Ly (6.27) 
In fact, the term Ly must be forwarded to the left-hand side, giving: 

— ■ - — — — = (A22 — LA12) X2 + (B 2 — LB X ) u + (A21 — LAn ) y 

And, making the change of variable w = x 2 — Ly , after straightforward oper- 
ations, the result is: 

y/y = (A22 — LA 12 )w + ( (A22 — LA\2)L + A21 — LAii B2 — LBi ) 

X 2 = w + Ly 

Undoing the state transformation T, going back to the original state variables, 
and stacking the first set of measured states, the output equation would be 
replaced by: 
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x = T ~ 1 




w + T - 1 





(6.29) 



A similar equation can be derived for a DT reduced-order observer. 
The observer dynamics is determined by the eigenvalues of: 



A22 — L A 12 



(6.30) 



Note that this reduced-order observer is a “current” observer, as the current 
output measurement is used to estimate the partial state (9 / 0). 



6.2.4 Separation Principle 

A two-stage algorithm applying pole-placement techniques to observer and 
state feedback controller design yields a closed-loop system with poles located 
at the union of those from each of the designs (under the assumption of 
negligible model error). The proof will be presented for the CT case, although 
an analogous one can be provided for the DT case. 

Let us connect a plant with equations (x = Ax + Bu, y = Cx ) in feedback 
with a controller (observer + state feedback replacing state by its estimation): 

x = (A — LC)x + Bu + Ly (6.31) 

u = —Kx (6.32) 



The normalised state space representation of the controller, including the 
observer 7 , is the n-order system: 

i = (A — LC — BK)x + Ly (6.33) 

u = —Kx 

The overall closed-loop system is 2n-order, with a state vector x c : {x,x}, 
whose dynamics is given by: 

d_ ( x \ _( A - BK 
dt\x) ~ \LC {A-BK- LC) 

Defining a new state vector 2 :”: {x,x — £} by the similarity transformation 
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applying (2.20), it results 



dx n c (A-BK BI< \ n 
~ V 0 A - LC ) X ° 



(6.35) 



' Note that it is a system whose outputs are the control actions and the inputs are 
the sensor readings, so it is a usual feedback controller, anyway. 
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Thus, due to the upper block triangular structure, the eigenvalues of the plant 
+ controller are those of A — BK and A — LC. This justifies the independent 
design of observer and controller gain matrices, and (6.35) is termed the sepa- 
ration principle. As previously commented, a usual rule of thumb is to design 
observer poles to be somehow faster than controller ones. The suitability of 
the approach depends on having a good signal-to-noise ratio. 

This is also applicable to the DT observer, as well as to the current and 
reduced-order observers, with the appropriate change of state vector. 

Instead of (6.33), the normalised state representation of a controller using 
a current observer is, denoting tp k = Xk-i- 

V’fc+i = (I- LC)(A - BK)ip k + Ly k 

u k = —K(I - LC)(A - BK)il; k - I<Ly k (6.36) 

Design code. The Matlab® command Kss=reg(sys,k,l) sets up the con- 
troller in (6.33). An example of CT design, given a plant, gs, and a desired 
pole location, pd, is: 

k=place (gs . a,gs ,b,pd) ; l=place(gs .a’ , gs . c 1 ,pd) ; 
rg=reg(gs ,k, 1 ’ ) ; 

the last line being equivalent to: rg=ss(gs.a-l , *gs.c-gs.b*k,l’ ,-k,0). 
The same commands carry out the DT design (including the sampling time, 
Ts, as a last argument to ss, as done below). 

The command dreg does the same with the current discrete observer. For 
a DT plant gsd and desired poles pdd, the code synthesising the regulator is: 

kd=place (gsd . a , gsd . b , pdd) ; ld=place (gsd . a ’ , gsd . c ’ , pdd) ; ld=ld ’ ; 
[a2 b2 c2 d2]=dreg(gsd.a,gsd.b,gsd.c,gsd.d,kd,ldc) ; 
rgd2=ss(a2,b2,c2,d2,Ts) ; 

or, alternatively, carrying out (6.36) directly: 

pp= (eye (2) -ldc*gsd . c) * (gsd . a-gsd . b*kd) ; 
rgd2=ss (pp , ldc , -kd*pp , -kd*ldc ,Ts) ; 

Computer code for real-time control will be discussed in Chapter 9. 



6.3 Rejection of Deterministic Unmeasurable 
Disturbances 

The present observer + state feedback equations are designed to modify the 
system dynamics, but they do not explicitly solve the “disturbance rejection” 
problem: the methodology only provides tools to ensure that, departing from 
an off-equilibrium situation, equilibrium will be approximately reached in a 
specified time (given by the prescribed poles). 

Enhancements to the approach will be presented in this section that are 
specially focused to tackle the deterministic disturbance problem. 
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6.3.1 Augmented Plants: Process and Disturbance Models 



As discussed in Section 2.10.1, in some cases a deterministic disturbance can 
be expressed as the output of an autonomous generator system. In engineering 
practice, constant, ramp and sinusoidal disturbances can be expressed as the 
output of a marginally unstable unexcited linear system with non-zero initial 
conditions: 

X d — A d X d > d — C d X d 

Process disturbance. In most cases, the disturbance, d , generated in an- 
other subsystem, is not directly measurable. Instead, its effects modify the 
process state 

x = Ax + Bu + Bdd 

and these modifications are measured by the sensors measuring the output 
variables of interest (y = Cx + Du). 

Output disturbance. If, on the contrary, the disturbance is pure measure- 
ment noise, it is added to the sensor readings and does not modify the plant 
state: 

z = Cx + Du + d 



However, the output variable which has to be controlled is still y. 

Of course, mixed situations can be thought of (x = Ax+Bu+Bdd and z = 
Cx + Du + Ddd). Writing the disturbance and plant equations in normalised 
form, the result is an augmented plant model: 



d_ 

dt 





(AB d C d \ ( x \ 
v 0 A d ) \x d ) 




z=(CD d C d ) ^ +£>« 



(6.37) 

(6.38) 



where, for process disturbance D d = 0 and B d ^ 0 and for output disturbance 
D d yf 0 and B d = 0. In any case, it can be easily checked that the disturbance 
state is unreachable by input u, as intuitively expected. 

Disturbance estimation. Let us consider how to cancel the effect of the 
disturbances on the true output y = Cx + Du. In the following, for simplicity, 
D = 0 will be assumed. 

The first assumption is that the whole augmented state (x, x d ) must be 
observable 8 . Then, an observer can be designed to estimate the process and 
disturbance states. Thus, (x,x d ) tends to its actual value on the real plant 
(in the absence of additional sources of perturbations and modelling errors) 
so that the designer can specify the time for convergence. 

8 This algebraic requirement has a clear engineering interpretation: the disturbance 
must, somehow, affect the outputs (if it does not, there is no need to deal with 
it). Thus, the assumption holds in most practically relevant cases, with at least 
as many sensors as actuators. 
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6.3.2 Disturbance rejection 

Once the estimate x d is available, the state feedback has to be extended so 
that: 

u = -I< ext ( * ) = - ( K K d ) ( * ) = -Kx - K d x d 
\ -Ed J \ J 

At first sight, this is another state feedback problem that can be solved by, 
for example, pole-placement as in Section 6.1.1. However, the disturbance 
state is unreachable so the poles corresponding to A d cannot be changed. The 
procedure to be followed is: 

• first, a state feedback law, u = — Kx , is calculated for the non-augmentecl 
plant, x = Ax + Bu, 

• second, K d is calculated to cancel the perturbation effect. 

Let us discuss the second step of the procedure. 

Output disturbance. If the disturbance is pure measurement noise, then 
K d = 0 as the observer, thanks to the perturbation model, is able to discrim- 
inate between signal and deterministic noise and the right control action is 
u = —Kx, discarding x d . 

Process disturbance. If the disturbance is acting on the process, the basic 
ideas are the same as in the measurable disturbance case discussed in Section 
4.6.3, replacing measured values by the estimated ones: 

• if there exists a matrix M so that B d C d = BM , it is said that disturbances 
enter by the input channels. After convergence of the observer 9 , a setting 

I\ d = M; u= —Kx — Mx d 



produces a closed loop cancelling d as B d d = B d C d x d « BMx d . 

• if the input channel condition does not hold, a matrix K d could be sought 
so that B d — BK d is small in a suitable sense. 

Example 6.11. Linearising and discretising a first-order plant, and adding an input 
disturbance, the following model is obtained: 

x k + i = 0.97xk + 0.06(ii fc + dk) 

Vk = 2x k 

The augmented plant will be formed by adding a disturbance model assuming a 
constant d, i.e., dk+i = dk, so the augmented state space representation is: 



mfc+ 1 ^V° 1 

y = ( 2 0 ) m k 



0.97 0.06 



Proof of the joint convergence of controller + observer would need a procedure 
analogous to that in Section 6.2.4. 
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where rrik is the augmented state vector ( Xk,dk ). If the “true” d does not behave as 
a constant, the above representation will have a modelling error. 

A regulator (for the non-augmented plant) achieving a settling time of 16 samples 
will be designed, i.e., with regulator poles at Pd = 0.05is « 0.83. The result is 
Ki = 2.333. 

Let us design an observer for the augmented plant so that the overall design can 
cope with constant disturbances achieving zero steady-state error. Observer poles 
will be placed at pd = 0.05 n ss 0.76 (45% faster than the controller one), by solving 
the equations of eigenvalue placement for A ext — LC ex t.A ext . After operation, the 
result is L = (0.2023 0.48) T . So, as disturbances enter by the input channel ( Bd = B, 
so M = 1), the overall regulator gain matrix is K = (2.333 1) and the joint observer 
+ regulator have equations (6.36): 



ipk+ 1 



0.4942 0 

-0.7968 1 



V'fc + 



0.2023 \ 
0.48 / 



Uk = ( -0.3565 0.9519 y k 



Vk 



and the resulting regulator transfer function (SISO) is: 

_ u(z) _ 0.95192(2 - 0.9143) 

(Z) ~ y(z) ~ (z - 1)(2 - 0.4942) 

As expected, it includes an integrator. It is left to the reader to check that the SISO 
transfer function from the disturbance to the output is: 

y(z) _ G _ 0.12(2 -0.4942)(2-l) 
d(z) ~ 1 — GK ~ (2 - 0.76) 2 (2 - 0.83) 

with zero DC gain and poles at the required positions. 

The use of a reduced-order observer could have allowed the design of a closed 
loop of order 2, with a first-order controller. 



Disturbance models in practice. Note that, in many cases in practice, 
the true physical source of all disturbances and their mechanism of action is 
unknown so that first-principle equations cannot yield a determination of Bd- 
Anyway, as disturbances must be cancelled by manipulation of the available 
inputs, it is reasonable to assume that disturbances are input disturbances, 
Bd = B and Dd = 0, and “invent” one source of disturbance for each actuator 
to implement the observer (M = I). In this way, the observer will calculate 
which value of “input disturbance” explains the deviations in sensor readings 
(irrespective of the true disturbances being applied at the input or at any 
other location in the plant). In this case, the control action is, directly: 



■u = —Kx - C d x d 



Indeed, for input disturbances (Bd = B in (6.37)) the regulator state 
matrix is given by (6.33), i.e.: 



A 



reg — 




A — BK — LiC 

-l 2 c 
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and, as it is a triangular matrix, the poles of the disturbance generator Ad 
are poles of the regulator. 

If constant disturbances are assumed, that is Ad = 0, it is interesting to 
realise that the estimator involves the addition of integrators. This is in accor- 
dance with the classical PI control technique to cancel constant disturbances. 
The previous example also illustrates these ideas. 



6.4 Summary and Key Issues 

State space representation allows for an easy extension of PD control laws to 
systems of arbitrary order via state feedback. If not enough sensors are avail- 
able, state estimation needs to be carried out. Combination of both approaches 
leads to the so-called “output feedback control” whose analysis constituted a 
major theoretical and practical breakthrough in the 1950’s and 1960’s. 

Regarding practical implementation, it allows the design of controllers with 
a prescribed settling time. The key issue is the existence of multiple solutions 
in the MIMO case so some may be the best with regards to some criteria, 
posing the optimisation problems to be solved in next chapter. Criteria that 
should be considered in practice are I/O pairing, sensitivity to measurement 
noise and limited control action. At this moment, the only available guideline 
is that positioning the poles near their open-loop position results in low-gain 
controllers and low-gain observers having reasonable applicability. In Chapter 
9, implementation issues are discussed. 

Integral action and, in general, deterministic disturbance cancellation can 
be easily cast into the state feedback + observer framework. 



6.5 Case Study: Magnetic Suspension 



A floating platform is controlled by magnetic drives acting on the three ex- 
treme positions by means of electromagnets. In Figure 6.2, a schema of the 
system is depicted [50], where: 

• x v : vertical displacement of the centre of gravity (G) of the platform, 

• x p : pitch angle, 

• x r : roll angle, 

• rf. distance of the i-extreme to the corresponding actuator. 

The non-linear electromagnetic forces acting on the platform are: 



F, 



= k j 




with j = 1, 2, 3 



where Uj is the voltage applied to the powerful j-electromagnet, and kj is a 
magnetic constant. 
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Figure 6.2. Magnetic suspension system 



To complete the model, force and torque balances are applied to the plat- 
form 10 , leading to the mechanical equations: 

( M x v = Mg - (Fi + F 2 + F 3 ) 

< Jp Xp = l\gF\ — l 2g (F 2 + F 3 ) 

Jr %r — ^3 g (^2 Al ) 

The distance from each platform extreme to the corresponding electromagnet, 
r*j, is geometrically related to the position variables previously defined, x v , x r , 
x p . The full model involves nine equations with nine internal variables. 

In order to derive a linear internal model, the position ( x v , x p , x r ) and 
their derivatives ( x v , x p , x r ) are taken as state variables and the force and 
geometrical equations, which do not involve dynamics, are linearised around 
an operating point, usually defined by the positions without movement. The 
input vector is composed of the voltages (or the currents) applied to the 
corresponding coils. The extreme positions are taken as components of the 
output vector, also requiring the linearisation of the output equations. 

x = [x v x p x r x v x p x r ] T ; u = [it! u 2 u 3 ] T ■, y = [n r 2 r 3 ] T 

Linear model. A laboratory platform has been modelled and linearised, 
leading to the model: 



Ax = A Ax + B Au ; Ax = x — x* — > x = Ax + x*; . . . 

denoting with ()* the steady-state variables: 
x* = [x* 0 0 0 0 0] T ; u* = [ul u* 2 ul] T \ y* = [ r\ rj r 3 ] T = [ x* x* x* ] T 
and 



10 



Assuming small deviations over the main inertia axes. 
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1 0 0" 
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0 1 0 
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0 


0 


0 


0 


0 


0 0 1 


; B = 


0 


0 


0 


1089.71 -16.4811 


-0.0424 0 0 0 


-2.4038 


-1.9050 


-1.9718 


-494.935 2029.55 


-0.2332 0 0 0 




23.605 


-10.4689 


-10.8362 


-4.4942 -0.8224 


1016.34 


0 o oj 




0 


24.2115 


-25.0619 



C = 



1 -0.327 0 0 0 0 

1 0.183 -0.12 0 0 0 
1 0.183 0.12 0 0 0 



Structural properties. It is easy to apply the analysis techniques developed 
in Chapter 3 and check that: 

- the system is open- loop unstable: 

eig(A) = [-45.1459 45.1459 32.8804 -32.8804 31.8801 -31.8801] 



- the system is state- and output-reachable, [u s v] =svd(ctrb(A,B) ) 
points out that x p and x p are the most controllable direction, x r and x r the 
second ones (3 times less), and the vertical position is 27 times less control- 
lable, 

- The system is state observable, 

-With [u s v] =svd(ctrb(A,B( :, 1) )), etc. each input only reaches four 
state variables, and with a bound on condition number of 10 5 , only two, 

- The observability space is dimension 4, for any single output, 

- The relative degree matrix has 2 in all elements. 

Centralised control design. Let us go for a multivariable control system 
with the following requirements: 

1. No steady-state error in position. 

2. Poles around —100. 

3. Output feedback, using a reduced-order observer. 

A centralised optimal control strategy for this system is reported in [51]. 

1. To fulfill the first requirement, an integrator should be added to each output 
(controlled variable): 



Vi = - ( yd,i ~ Hi) —> Vi = Ud,i ~ Hi , i = 1, 2, 3 
s 

Thus, the resulting augmented system (dimension 9) will be (6.1.2) with aug- 
mented matrices: 



Aa 



\ O' 

-CO ’ 




Ca = 



CO 
0 / 



Any stabilising state feedback will match the first requirement. 

2. To fulfill the second requirement, a pole-placement problem (using the 
Matlab® command place, for instance) will give the state feedback matrix: 
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K = place(Aa, Ba, [-100, -100, -100, -102, -102, -102, -104, -104, -104]) 
according to the desired pole position. It yields: 



K = 10 5 



-0.048 0.009 -0.000 -0.0005 0.0001 -0.0000 1.133 0.225 0.225 
-0.054 -0.006 0.007 -0.0005 -0.0001 0.0001 0.284 1.663 -0.162 
-0.052 -0.005 -0.006 -0.0005 -0.0001 -0.0001 0.274 -0.157 1.607 



The Simulink® diagram is shown in Figure 6.3, assuming all of the state vector 
is measurable. Block F is in charge of generating feedforward (2-DoF) actions, 
if so desired, to modify the tracking response, i.e., v = F(s)r in (6.2). 




Figure 6.3. Integral control by augmented state feedback 



3. To implement output feedback, velocities should be estimated. Note that 
the incremented state variables, the integrators, are obtained from the outputs 
and so they are accessible. Let us concentrate on the non-augmented system. 

To better follow the reduced-order observer design, let us take a similar- 
ity trasformation as proposed in (6.2.3). In this case, with F = O3X3 hx 3 , 
Equations (6.23) result in: 



Xi 




03x3 


1 

CM 

K 




Xi " 




03x3 




= 










+ 




X 2 




A21 


CO 

X 

CO 

0 




_X 2 _ 




L b 2 \ 





' 1 -0.327 0 




' 423.3 333.4 333 ' 




' -2.403 -1.905 -1.972' 


A 12 = 


1 0.183 -0.12 
1 0.183 0.12 


; A21 — 


-4157 1832 1830 
0 -4237 4233 


;B 2 = 


23.6 -10.47 -10.84 

0 24.21 -25.06 



Remember that the reduced-order observer equation is (6.27), and the ob- 
server dynamics is determined by the eigenvalues of A 22 — KqA\ 2 . To com- 
pute the observer gain, its poles should be faster than those of the controlled 
system. Again, using the Matlab® command place: 

Kl = place(A^ 2 , a[ 2 , [-150, -150, -150]) 



it yields: 












186 6 Fundamentals of Centralised Closed-loop Control 



Ko 



53.8235 48.0882 48.0882 

-294.1176 147.0588 147.0588 
0 -625 625 



The original state vector is obtained by the inverse transformation: 



x = T 1 x est = T 1 



y 

%2,est _ 




Figure 6.4. Reduced-order observer 



The Simulink® diagram of the observer is shown in Figure 6.4. The Mat- 
lab® code that yields a normalised internal representation, (6.28)-(6.29), is: 

Aro=A22-K0*A12 ; Bro=[(A22-K0*A12)*K0+A21-K0*All B2-K0*B1] ; 
Cro=inv(T)* [zeros(3,3) ;eye(3)] ; 

Dro=inv(T)* [eye(3) zeros(3,3) ;K0 zeros(3,3)]; 
rdobs=ss(Aro,Bro,Cro,Dro) ; 

The observer has six outputs (six states, in original coordinates), six inputs 
(three plant outputs + three plant inputs) and three internal states. Alto- 
gether, the output-feedback integral control is implemented as shown in Fig- 
ure 6.5. The controlled plant behaviour, under step changes in the references 
(F = I), can be seen in Figure 6.6, where a settling time of 0.06 s can be 
realised. 

In order to show the performance degrading due to the observer, in Fig- 
ure 6.7 the free response (output 1) of the controlled system with observer 
and with direct state access can be compared. An initial condition vector 
xq = [111000] is assumed. Similar responses occur in the other output 
variables. A faster observer could have been designed to achieve less difference 
in the nominal responses. 
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Figure 6.5. Output-integral feedback control 




Figure 6.6. Step response: integral-output feedback 




Figure 6.7. Free response of the controlled plant with and without observer (yi) 



Decoupled multi-loop control design. Another control option, as devel- 
oped in the previous chapter, is to decouple the three subsystems (attached to 
each position and its derivative) and to implement a multi-loop control on the 
decoupled system, by designing a PID control, for instance. The decoupling 
may be achieved by a feedforward transfer matrix or by state feedback. As- 
suming the state is accessible for measurement (otherwise using the observer), 
the state feedback solution in Section 5.3.2 on page 139 can be implemented, 
as the plant has no zeros (check). In particular, it can be checked that all 
three relative degrees, r i, r 2 , r 3 , are equal to 2, and the matrices Q and H in 
(5.17) are: 
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" —10.1226 1.5184 1.5716 ' 




"1251.558 


-680.143 


0.0338 


0 0 0~| 


1.9159 -6.7261 -0.9475 


; H = 


999.681 


355.025 


-122.046 0 0 0 


1.9159 -0.9154 -6.9621 




998.602 


354.827 


121.876 


0 o oj 



so, the decoupling feedback and feedforward terms in (5.19) are: 





"176.1111 -57.5883 0.0000 0 0 0" 




' -0.1068 -0.0212 -0.0212" 


K d = 


175.0000 32.0250 -21.0000 0 0 0 


, F = 


-0.0268 -0.1568 0.0153 




168.8889 30.9067 20.2667 0 0 0 




-0.0259 0.0148 -0.1515 



It can be checked that the decoupled transfer matrix of the system is: 



G dec {s ) = C(sl -A- BK d )~ 1 BF = 



i 0 0 

s 2 

0 i 0 
0 0 \ 



so, three straightforward PD control loops will now suffice for decoupled pole- 
placement. Indeed, with a controller with transfer function Gr = K d s + K p , 
each loop will have a characteristic equation s 2 + K d s + K p = 0, so to place 
the poles at —100, the gains K d = 200, K p = 100 2 , will suffice. 

The decoupled control schema can be seen in Figure 6.8. 



I 



Ngr(s) 



Feedback-decoupled system 



□ 



| Dgr(s) | 






PID 1 




Ngr(s) 

Dgr(s) 


► 


Mux 


PID 2 


if 




1 Ngr(s) 





Dgr(s) 



i — 

K U Suml 



x' = Ax+Bu 
y = Cx+Du 



System 



Figure 6.8. PD decoupled control 



Remark 6.12. The solution in Figure 6.8 can be improved. Indeed, if the state 
is accessible (or a state observer is implemented) the output derivative can be 
directly estimated from the observer output (y, = iCAx), not depending on 
u as the relative degrees are j*j = 2. So, the PD controller can be implemented 
as an outer static state feedback, without carrying out additional numerical 
derivatives. Remark 5.11 about steady-state errors applies here. 
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Optimisation-based Control 



The objective of this chapter is to present various controller design techniques 
based on the optimisation of a (scalar) cost index. First, an optimality-based 
approach to state feedback and observer design will be presented. Then, the 
popular multivariable predictive control will be briefly discussed. The chapter 
will end with a norm-optimisation framework that is able to include some of 
the previous methodologies as particular cases. 

Motivation. The pole-placement framework discussed in the previous chap- 
ter accounts for settling-time specifications, but in multivariable systems there 
is no way of specifying overshoot requirements usual in SISO cases; in fact, it 
is difficult to even define them. Furthermore, the poles are, from an engineer- 
ing view, a result from the roots of a determinant that has an obscure relation 
to practical requirements such as: 

• tighter control of output y\ is desired, either because variable y 2 is unim- 
portant and its deviations can be much larger or because disturbances 
happen to show a minor effect on y 2 , 

• with a particular configuration, actuator u\ often saturates whereas u 2 
seldom does: a redistribution of the control authority is desired. 

Indeed, in MIMO systems there are multiple solutions to the pole assign- 
ment problem, and different actuator amplitudes and precision requirements 
for each controlled variable: it is difficult for a pole-placement design to be 
modified to improve control on a particular output or to force lower com- 
mands to a particular actuator. Furthermore, some of the states may have no 
clear physical meaning and may not be quite controllable or observable, so 
using high gains to assign those poles may not yield a significant input/output 
improvement. 

To account for these situations, a new design paradigm was developed in 
the 1950s that was based on optimisation of a cost index, flexible enough to 
deal with the above-mentioned situations. It was conceived as a generalisation 
of least-squares problems. Optimisation-based control of dynamical systems 
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reaches significance after the works by Bellmann [24], Pontryagin [103] and 
Kalman [70], originated by an earlier paradigm shift from transfer functions 
and frequency response to state space formulations. A general framework, able 
to accommodate robustness considerations, was developed in the 1980s [44]. 



7.1 Optimal State Feedback 

Many control problems can be expressed, in plain terms, as minimising the 
“deviation” of the controlled variables, y, from their prescribed set-points, 
r. The meaning of deviation can be formalised as, for example, ( y — r) 2 . In 
this way, squaring the deviations indicates that positive and negative ones 
are equally undesirable. Initially, r = 0 will be assumed, as it denotes any 
constant equilibrium point on a linearised model. 

The Cost Index 

To define the optimisation problem, a cost index reflecting the engineering 
specifications must be set up. As signals change over time, the control objec- 
tive should be oriented to minimise the “accumulated deviation”: 

/»00 00 

Jc = y dt\ Jd = ^ ] yj, 

-'° k—0 

where J c refers to CT designs and Jd to DT ones. 

These measures are a common performance indicator in SISO control (ISE, 
integral of squared error). Indeed, they are also of extraordinary importance 
to general control theory. This accumulated deviation is named as the 2-norm 1 
of the signal and is usually denoted by ||y|| 2 - 

Transient deviations may originate from two sources: (a) off-equilibrium 
initial state, (b) disturbances. The problem to be addressed at this moment 
will regard the first one: the objective will be reaching a desired operating 
point with minimal accumulated deviation. The second one will be the objec- 
tive of the next section. 

Control cost. Large amplitudes of the manipulated actuators also imply a 
“cost”: risk of saturation, energy consumption, etc. Indeed, a “too-aggressive” 
controller would make the output norm small by injecting control signals with 
large amplitude to quickly drive the system to equilibrium. 

To avoid saturation and extend actuator life (and to decrease sensitivity 
to modelling errors, see Chapter 8), the “optimal” regulator must take into 
account penalties on u as well. To achieve that, the term f u 2 is usually 
included in the index to be minimised; otherwise, the problem is ill-posed. 

1 There are another possibilities for measuring the “size” of a signal, such as the 
integral of the absolute value. In Appendix C, formal definitions and a summary 
of other choices for signal and system norms is given. 
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Weights. In MIMO settings, there will be different relative importance be- 
tween the variables involved: some form of relative weighting must be set up. 

In principle, minimising a weighted sum of the 2-norm of inputs and out- 
puts (such as 5Zr=i fo° QiViit) 2 dt + YhL 1 r i / 0 °° u i{t) 2 dt ,) might be a better 
approach to obtaining a good-performance regulator, with low energy usage 
and greater ease of tuning than a pole-placement approach. 

Example 7.1. Let us consider the simplified headbox model, 2.12.1, presented in 
Chapter 2. If a sudden disturbance causes the process to depart from its prescribed 
set-point, there may be different practical requirements regarding the transient devi- 
ations of each of the outputs, and the use of each actuator. Let us think on allowing 
four times less deviation to the stock exit speed, v, than in the stock level, h, and 
desiring to use three times less the stock flow, q, than the air pressure, p. Those re- 
quirements can be approximately expressed as the following optimisation problem: 
given a starting state a:(0) 0, minimise: 

pOO 

J= (4u(t)) 2 + h(tf + p{p(t) 2 + (3<?(f)) 2 ) dt (7.1) 

Jo 

where p is a user-defined small number limiting control activity. In this way, to make 
a particular variable smaller, its weighting in the control cost index is increased. By 
denoting process variables with the usual notation (y, u), taking into account that: 

!6 y\ +yl + p(ui(f) 2 + 9u 2 (t) 2 ) = (j/i y 2 ) ^ +p(ui u 2 ) (^q g j 

the index can be cast into a matrix form ( Wi and W 2 are weighting matrices): 

POO 

J = (y T W iy + pu T W 2 u)dt 
Jo 

and, replacing the output by its expression y = Cx, index J is an expression de- 
pending on future states and inputs: 

poo 

J= / {x T C T W\Cx + pu T W 2 u)dt 
Jo 

General linear quadratic regulator problem statement. From the pre- 
vious example, in a general case, the optimisation problem can be formulated 
as follows: 

Given the process defined by (2.17), (or (2.29) in DT), with initial state 
a:(0) = £ 0 , find the control input minimising the index: 

J c = ^ f (x(t) T Qx[t) + u{t) T R:u(t)) dt + ^-x(tf) T Siyx(tf) (7.2) 

2 J t=o 2 
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where Q, and Sn are positive semi-definite n x n matrices, R is a positive 
definite m x m matrix 2 and tf (N in the DT case) is a user-defined “control 
horizon” . 

Note that, as we are working on linearised models, the variables are incre- 
mental, i.e., the index refers to deviations or transient errors when trying to 
achieve a desired set-point: Q is the cost of the transient path, and Sn is the 
“final” cost of not “hitting” the target state 3 . 

The previous index refers to control tasks lasting a fixed time (such as po- 
sitioning a robotic arm). In process control, running continuously, the indexes 
are usually defined with an infinite final time, as in the previous example: 



✓•OO 

/ [x(t) T Qx(t) + u(t) T Ru(t))dt 

Jo 


(7.4) 


1 X 

J = 2 'y 'X x k Q x k + Wfc Ruk ) 


(7.5) 



fc= o 



In this way, the control engineer casts the specifications into suitable ma- 
trices Q and R , as it was done in the example. 

7.1.1 Linear Regulators 

It can be shown (see a detailed problem statement in Appendix D) that the 
solution to the minimisation of the cost index (7.4), where x(t) is the trajectory 
of the CT system x = Ax+Bu, is a linear time-invariant state feedback , similar 
to the solution of the pole-placement problem, (6.2), being: 

u op t(t) = —R~ 1 B T Sx(t) = —Kx(t) (7.6) 

Matrix S is the positive definite solution of the Riccati equation [133]: 

0 = A T S+ SA- SBR^S+Q (7.7) 

Similarly, for a DT system Xk+i = Axk + Buk, the minimisation of the 
cost index (7.5) leads to the linear state feedback 

u k ,opt = -R~ 1 B T S x k = -Kx k (7.8) 

where matrix S is the solution of the DT Riccati equation: 

S = Q + A T SA - A T SB(B T SB + R)~ 1 B T SA (7.9) 

2 Otherwise there will be a non-penalised control direction so the optimal controller 
would have infinite gain on it: the problem would be ill-posed. 

3 Other optimisation problems with significance in control engineering are the fixed 
final state (Sn tending to infinity), and the CT minimum-time control (in which 
a fixed final state must be reached in a minimum time with a particular actuator 
saturation limit). The reader is referred to [81, 122] for details on these. 
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A simplified derivation of the optimal controller, for the DT case, is briefly 
presented in Appendix D.2. The reader is referred to [122, 81] for ample dis- 
cussion. As the cost index is quadratic and the system model is linear, the 
resulting regulator is named in the literature as linear quadratic regulator . 

In the LQR design approach, the only design parameters are the weighting 
matrices, Q and R , and some other properties, like closed loop bandwidth, 
pole position or response speed and damping, are not directly pursued. As a 
result, achieving a particular settling time (pole positions) must be made by 
trial and error on these matrices. In any case, the LQR solution has a number 
of properties and options that are rather interesting from the control user 
viewpoint. 

Matlab® implements the CT optimisation routines in its command lqr, 
with the syntax: [K,S,E]=lqr(A,B,Q,R). It returns the optimal state feed- 
back gain, K, the Riccati matrix, S, and the eigenvalues, E, of the closed-loop 
system (A — BK). The command dlqr is used for the DT regulator. 

Once the LQR controller is obtained, the dynamic behaviour of each con- 
trolled variable can be checked and the closed-loop poles can be evaluated. 
If we want to modify the system behaviour, the tuning parameters are the 
weighting matrices, Q and R, and some basic interpretation and rules of thumb 
are available. The following example outlines the procedure. 



Example 7 .2. Let us have a third-order system with state space representation: 



dx _ 
dt 

V = 



(-2 1 0 \ 
0-3 0 
\ 0 0-4/ 

/ —17 4 -10 \ 
^5 8 -6 ) 



x + 



x 



0 

-0.5 

0.2 



u 



where y\ must have control four times tighter than 1/2 and actuator 112 may have 
three times more deviation than actuator u\, when an initial off-equilibrium situation 
caused by a sudden disturbance or set-point change is corrected. 

The solution for the problem in Matlab® language is: 



[K, S ,E] =lqr (A,B ,C’ * [16 0;0 l]*C,rho*[9 0;0 1]); (7.10) 

where p can be adjusted (by trial and error) to achieve a particular settling time. For 
example, a controller achieving the desired input and output deviation objectives 
and a settling time of 0.4 s can be found with p ~ 2. Figure 7.1 plots the result of 
the simulation code below (lines labelled as (a)), where the output vector has been 
augmented to include u = — Kx : 

sscl=ss(A-B*K,B, [C;-K] ,0) ; [y t x] =initial (sscl , [1 1 1]’,0.59); 
figure(l) , plot (t ,y ( : , 1 : 2) ) , figure (2) , plot (t ,y ( : ,3 : 4) ) 

Note that the settling time for y\ is faster than that for 2 / 2 , as designed. However, 
in spite of our decision to “punish” deviations in u 1 , the optimiser still uses ui 
quite a lot. That occurs because ui has more than double the “gain” in terms 




194 



7 Optimisation-based Control 

Output Control Action 





Figure 7.1. Non-zero initial condition response of optimal controller (3 designs). 



of input /output controllability 4 , so to achieve the required performance in y the 
optimal seems to be using actuator ui. Based on these results, matrices Q and 
R can be fine-tuned to suit the engineer’s needs. For example, to increase control 
requirements on t/ 2 , Q( 2, 2) can be changed to 3. To decrease amplitude of ui, R( 1, 1) 
is changed to 15. To make the loop faster, p is decreased to 0.1. Figure 7.1 plots the 
output of this second case, labelled as (b) . Control actions (not plotted, to avoid 
messing up the figure) are five times bigger: the approximate starting value of u i is 
—60, and that of U 2 is —120. Further refinements can be made if so wished. 

Example 7.3. If a pole assignment solution is searched using Matlab® commands 
and having the same poles as those resulting from the LQR design (vector E in 
(7.10)), a different feedback law will be obtained and a different dynamics will relate 
the input/output variables in a MIMO case: assigning the poles at the same place 
than the LQR design (a) in the previous example yields, for example, the outputs 
labelled as (pp) in the above figure. Control amplitudes (not plotted) are one third 
of those in the LQR design. 

Note that the individual adjusting of input and output deviations from an ini- 
tial non-zero state (by trial and error, however) is usually more related to “real 
engineering” MIMO specifications than pole-placement methodologies. 

Stability. The (infinite time horizon) LQR controller always yields stable 
closed-loop systems if some conditions are satisfied: 

• the system (A,B) is controllable or at least stabilisable (i.e., the uncon- 
trollable modes, if any, are stable) 

• Q is positive definite so there does not exist a non-penalised direction in 
state space. A softer condition requires all the state variables (at least the 
unstable modes) to be weighted in the cost index, in such a way that if 
Q = N t N (i.e., a “fictitious” output, y = Nx, appears as y T y in the 
index), the pair ( A,N ) is observable. 

Indeed, in this case, a controller K exists so that all closed-loop poles of 
A — BK can be placed in a prescribed stable location. This controller will have 

4 As an exercise, check the three singular value plots of the open-loop transfer 
matrix with one and two actuators, to verify that input 1 is responsible of almost 
all the “maximum gain” all over the frequency range. 






